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B study was conducted to '(1) assess the relation of 
different CETA aanageient decisTbns at the priae sponsor level to 
prograa goal achievement and (2) assess the conditions under which 
specific aanageient decisions seea losf J.ikely to laxiiise goal 
achievement . Bembers of a research t^a visited 15 prime sponsorshxps 
throughout the United States to collect dita^ on seven different 
external/ local conditions and sysfceaatically investigate eMght areas 
of loca;. management decisions. Seventeen Ohio prime sponsorships for 
■hich there was detailed data available were used as a comparison 
group. The conclusions were that (1) CBTB at the local leirel is not a 
Itighly constrained system; (2) local programmatic choices >re not 
djBtermined by factors such as unemployment, the history of pre-CETA 
manpower programs, demographic composition of tlie community^ the 
nature of persons served, or the activities of the Department of 
Labor; and (3) pragram perfprmancb is significantly affe^cted by . 
factors over which local managers have considerable control; program 
•ix; programmatic priorities; and management decisions in the areas 
of staff quality,' data collection and ase, monitoring and evaluation 
of programs, degree of subcottractlng for service delivery, use of 
reguests-f or-proposal for subcontractiag, open decision making 
centered in the advisory counc0, and conflict managements strategies. 
(B8J . 
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TITAbsfTirtT Conclusions are based on data from field work in JZ prime sx>onsorships and 
a^^egate data on all primes. GETA at the local level is not a highly constrained 
systerju Local prof^rammatic choices are not detenained: by factors such as unemplo 
the* J^S'to^ or pre-CE A -manpower programs, demographic composition of the community, 
the nature of persons served, or the activities ^of DOL. Program performance is 
siCTifi'cauitly affected by factors over which local managers have considerable controlL 
program mix; programmatic priorities} and management decisions 'in; the areas of staff 
qualit5^, data collection aind use, monitoring aind evaluation of programs, degree of 
subcontractihr; for service 'delivery, use of requests-fdr-proi>osal for subcontracting 
open decision -making centered ^n the advisory council, and conflict maJiatgement 
strategies. 
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trJiFATalY NOTE 

# 

» This is the last in a series of reports that have -focused on the * 
relation of JZllA management decisions at the prime sponsor level to 
prbgram goi^l achievement. The central* objectives of the research have 
been 1) to assess the relation of different ^nagement decisions to 
goal achievement and 2) to assess the conditions under which spec-lfic 
management decisions acem most likely to maximize/ goal achievement. ^ 

1 The research has been supported by a grant from, the Employment and ' , 
Training Administration of the U.S. Department of Labor <No. 21-39-75-10)* 
and by 'resources of the Mershqn Center of Ohio State University.. Research- 
ers undertaking such projects for the Department of Labor are encoxiraged to 
express their own fudgment. Their interpretations d9 got necessariiLy 
represent the official position or policy of the Labor Department. The * 
authors are solely responsible for the contents of the report. 

Members of the research team visited 15 prime sponsorships throughout . 
the United States that were chosen to be illustrative of areatf. in *hich 
management decisions have been' consciously linked to the attainment of 
programmatic* goals. They also visited all ten Regional Offices of .the, 
Department of Labor'. Three progress reports from the project (dated October 
31, 1976; January 31, 1977; and April 30, 1977) contain .detailed analyses 
of each of t^iese 15 sites. ^ ' 

We are grateful to a large number of indiyiduals in t/ie sites we have 
visited and also to a la'rge number of ETA employees in WashingTOt and the 
Regional Offices ^or their splendid cooperation. Many have willingly 
participated in long interviews. Ofhers have provided additional essential 
data. ' Withjout a higli degree of cooperatlpn and supt>ort from, all of these 
individuals this research would not have been possible. 
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The broadest coucluKidn from this study is that CETA at tjie local 
level is not a highly constrained, systei^i. LocaLdecision^Knakers, particu- * 
larly very corpetent* and conniittea- local professional staff members, have 
a great cteal 'of latitude to choose different options as they design dqilvery 
systems* Taey hlso have a great deal of influence la determining who gets 
ser\^ed and how well the programs" per form. 

VJeak (^r non-existent constraints^ that were found (sijme pf which -are . * 
of tew mistakenly cla'iiAed to be very important) include' the following: 

1> Unemployment atf the local le\^l is only a mild constraint on -the 
^options open to the CETA staff and on the level of performance of their pro- 
grams. . ^ • ^ 

' . * ' "» 

2. ^T]\e history, of pre-CETA manpower programs in localities is a 
fading cons traint even' in those areas fn whith there was a sizeable pre-CETA^ 
manpower establishment, ' . . 

3. The demographic composition of a community does not, within very 
broad limits, determine the nature of those individuals whom the prime 
sponsorship* chooses to serve. 

4. The aggregate nature of persons served does not determine the 
level of program performance. 'The "Hard to serve" (or relatively most 

, disadvantaged) can be emphasized and tlfe prcTgram can ^till perfjDrm -very ^ 
well. ' ^ * ^ ^ 

5. There is no consols tent, major impact on local decisions and program 
performance by t^e activities of the regional offices of the Department ^ 

of d-abor k ♦ ^ - * . ' 

Program performance was defined in teVras of characteristics of 
participants served (and conscious choice of participant priori t;les) ; 
general achievement of local goals; placement; non-positive ;termlnations; 
costs; and the ^eduction of^unfocused conflict, j Rblationships that were 
found to be important in ex^pXSTtfting' program performance were: 

1. Program mix, which was itself influenced by the perspnal 
preferences of -the most important actors in the local manpower system,. Has 
a" direct impact on performance: 

a. Levels of s^i^vice to the economically disadvantaged and woroer? 
are affected by. relative expenditures on Title I public service 
employment, classroom training, and work experience. 

I b. Relatively high expenditures for^and enrollments in on-the-job 

training are associated with good' performance in terms of placement, 
non-positive terminations and costs. * , ^ 

c. Relatively low expenditures for. and enrollments in' work ; 
experience are associated with good performance in terms of placement 
^ and cbsts. » , ^ 



2. Tha personal pref eionces , priorities, afifl conbite:>nts of th^ 
most influential actors in the manpower system Rave a djlrect impact on 
perfortaancet ' ' * * P ^ 

' / .X . ■ 

a* Staff \».orabers , who a re usually the most in fluentl,al persons 
In the system, are more likely ^o achieve goals bn which they puC a 
hi^he^p. iority than those on which they put a Jower priority. 

b. SC-affs w'ith stronger commitments to .traitiing programs and 
placements will also be the most likely to have- programs that perform 
better^in terms of placement and tests. 



3. Sevan kiads of management decisions ^were observed to ha\?e ^pecif ic 
beneficial Impacts on program performance: 

•a. Development of a high quality staff . impacted positirely on 
general goal achievement, placement, and pon-positive t^efminfations . 

b. Collection and use of good data for planning led tfo a more 
conscioi^s choice of participant priorH:Jtes. ^ , 

c. Development of high quality monitoring and evalu|ftion ' af 
programs had a deslrable-« effect bn placement, costs, and H^he reduction 
of unfocused conflict. 

d. A high degree of subcontracting for service delivery helped 
lead to good , performance in terms of general^oal achievement, place- 



ment, arid costs i 



ii 



e. The'use qf some forra.jof requ^st-fOT-p'roposal for subdontracting 
helped reduce unfocused conflict. 

f. Local commitment to developing and using an open decision-, 
making system (Including an involved advisory council) resulted in ^ " 
both a reduction of unfoc^ed conflict and a conscious choice of 
participant priorities. 

g. A conflict management strategy aimed at focussing conflict 
rather than avoiding it totally led to conscious choice tf participant 
priorities dnd a relatively high degree, of general goal achievement 

^ (as well as achieving its primary gbal ot deducing unfocused conflict). 

t Specif,ic recomnjendations based on the findings and observations of the 
study ate offered in seven major areas: 

1. Service to th^ disadvantaged. ^ ' > . 

2. Level of commitment to training and placement. 
. 3. Open decision-making at the local level • 

4. Monitoring and evaluation. 

5. Subcontracting and s^^ice deliverer selection. 
.6. Business involvemeni^K^CETA.* 

7. Organized labor involver^int in CEXA.^ 
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INTRODUCTION 



This report* and the, jproject ''from which it sterna ^rc focv'-^ed on -tKc* 
relations between management decisions about CETA at the prime sponsor livaX 
and achlever-r-,^ of prof,rainmatic! goals b^r prime sponsors. Our broad research 

strategy has been Avefold: ' ' ' * . 

T / * , ' - . 

.1. To describe the phenomena in which we are *i!iterost'»d'i-\a £:cj;loLi 
of Individual caoes.' ! • 
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2. To de3f^.ribe those phenomena in aggregate terucco as tc emph<U5ii-:G 
the patterns that ai5e present, 

3. To explain what we* have observed in theJ invlivl«iuci cases. 
; . V ^ ^ . \ — 

4. , To Explain the aggregate pattei^s we h^e oboervc.d. " • 

5. To copcentra-te o^i aSrpects of CETA management thatJare relatively 
manipulable by local staff and/or able to be .iftf luenced by the Deparlmeni:' 
of Lab^r so that meaningful policy recommendations (based on explicit 
assumptions about programmatic goals) can bl.made pn th6 basis of our 
findings. " ' \ . 

CONCEPTUAL FRAt'ISWORK ^ . ' ' 

The Comprehen^i¥€ Employment and Training Act er^bodiea the belief that 
local price sponsors know best 'how and when to respond to i;hat, specif ic. 
local conditions in order to achieve the general ^odlb^ of the progi^am. 
NationalJy, ' there has been ^i:eat variation among prime sponsorships in . ^ ^ 
. terrfis of' types of conditions fac^d, the types of progranmatic r^ponses 
generated, and the results of the responses.' . ^ 

Quv central research question can be stated siirply: under what 
couiitlons do \;\\ot management de<j^ision choices seem moot likely to enhance 
d.^'iired program performance? 

We bac^^n with the belie'f that prime sponsor pexTonuance is Inf licenced 
both by a v£;rlety of Qondittons that are external and antecedent to m5»ns<;a- 
vi^^t declfsicns and by those decisions themselves. Our general belief bad 
solid CDplrical grounding in the findings of a twpryear study w^ conducted 
on 'the implc:aentation of CETA in 17 oHio prime sponsorships (se*e Riplfjy 
and others, 1977). The broad relationships we set otitfeo explore are ' 
sunrmari^.ed very simply in Figure 1. * ^ 

W'^ l^yctfirnatlcally investigated a number of aspects of Tevcn rlf^Rrr^nt 
bxterudl Lcc^S. C^^nditions in prime sponsorships: 

1. Economic conditions. ^ 

2. Demographic characteristics. 

3. '» "The history of employment find' trailing progrej^js. 

is T ' 



Figure 1: - General' Model of ^la^ionships to- Be' Expicrr 
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4. Local 'govenimQut otructure/ » ' ' ^ 

^ 5,» The attltufleg of various^ actors with sonio actnai" or po.cnt5c>l 
# Influence over declolonn toward ipmployment and training progvc^ri3. 

^ ^ r ^ ' 

•6, .The fornal cdiuiu:»3tratlve location of tha CETA t^nit. 

7, Tlie resources allocated ko tl^ staff of the CIST^ jinit in torma of 
both bu48®t and personnel (nuTii)itr, quelif icatiom, pay, a'.turia- of perefennsl 
systen). ^ - ^ 

All of these ccnditions are relativrily hard to r.H.^ncc th^rou^h fc/rcltic 
act-ons by local staff members; some are basically jT.pors:Lble to c?^f.i»i3.? 
through rtaff action. Only number 7 is open to much short -run action by 
lo^cl staff members and even ii that area the rocai.fov* rranuwiver is li>cely 
to ba quiue rest^cted, , Tnus these conditions, tend to }>c "glvcns'' wj.th 
vhich local staff members must de*l^l. • 

We also' systematically investigated eight different areas of Local 
Minrgemfmt ^Decisions in which the potential for short-rvn change on the basis 
• of local staff choice is considerably greater: ^ 

.•1, The degree of both administrative and progranmatic integration ^ \ 
or separation of public gervioe employment (PSE) programs with o^il^er CETA 
programs • , ^ . , * 

2. The location of pcrvice delivery oper^lng responcibilitics (t!»G 
mix between in-house progi/ams and those contraoced out), • 

3. The nature of service deliverer selection processes. ^ 

4. The nature and use of monitonlng of prograois^. 

5. The natur^ end use evaluation of programs. 



X 

6, Other aapccts of program design (most of thef:e were specific to 
individual priaasffffnsorships; the -place of the Employment Service in the 
program was tho one feature we looked at in all cases) • , 

7, The nature of staff relation with other key actor^i: politiqaL 
officials. Manpower Advisory Councils, business, organized labor. 

8, The management of actual ot> potential coflflict in the manpower 
system, i • * ' " . 

We loolrod at Prime Sponsor Performance in a humb^r of different v;ays 
that will be ciT^cified in the body of the analysis that f callows. In 
ro^eral, we investigated performance- in relation both to presumed national 
goals for CETA and bith explicit and implicit local goals. ' , 
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DATA BASE AI^D t^ATURE OF THE ANALYSIS . 
' ' , ^ ^ 

Data hasei •* * • v ^ \ 

♦ A^Very larr.>^ <}ava bae^^^s created specif Ically lor th/'3 prcjr.^v. 
In addition, pact^of tl^e yeiy 'large data base created for the prcviop? pro- 
ject on Ohio.CGee Ripley^ anjf others, 1977: 1, 3, for' a capsule de&c-:4.ption) 
was also utilized. Data coH^ctfed during the l^U r^onth liie' of the 
present project, (April .15, 1976 - June 30, 1977) were of two primary !;ln » 
Firsts a grelit r^ge, of data^^ all of the fac?tors l:|.oCed' abpvs* vai 
collected for 15 prlitie ^poq^orships. thase data came 'prin: ^rlly iY^m 
•sites themselves- and also from' the national and rpci'^nil offices of u,r 
Dep?.rtmenl of .Labor, * and state offices of the Employmert Liervice, Soooad, 
aggregate data on performance were collected for all primp, sponsorships 
in - the counti^. " ' » . > ^ " - 

> The data on the 15 sites cape frpjn such eourcen as the 1970 C"^>^»is; 
quarterly reports f lied by tW sifes with the Departuent of Labor ^roia 
Sepvetnber, 197^, through -De cetnber, 1976 (although the quality of the 
Septenfccr, 1974, r^orts were so mixed we did not use them in the analysis); 
Employment Service AniiuaJkReports (ESARS) ; Employment Service data on - 
unemployment; a variety or^documents and files (annual plans, MC minutes 
and 4plnutes of other- relevattt meetings, newspaper clippings, memoranda 
^^nd letters^ internal reports. Regional Office field «asseBsments and * 
backup Biaterials) ; between 600 and 700 personal interviews with professional 
sttaff, political officials, key MAC members, service deliverers at the local 
leveL and a range of individuals at thftyapproprlate Regional Office (the 
Rejglon^l Admlnitttrator or* his Deputy, the relevant Associate Regional 
Administrator ariQ his Deputy, and one or moret Federal Representatives 
>7ho were or had been assigned to the specific sit^s); jailed questionnaires 
'for all^MAC members; and observation of MAC meetings and other relevant 
meet!lngs such as Executive Boards. 

The exact nature of the 'data used for specific analyses V^il be 
indicated In the body of the report. ^ ' ' 



Nature of t^e Analysis . • 

The progress reports from this project contain Retailed studies of 
the 15 individual slt^s and tentative Conclusions based ^n' comparisons of 
/thoce sites. • * ' ^ . • 

The present report uses a variety of ^comparative frameworks in the 
analyses that are performed. Compar:f.8ons are made between Individual prime 
sponsorships and different groups of prime sponsorships both at single 
points in time and over time. Comparisons used will be specified at 
appropriate places in the report. In general, we analyzed prime sponsorships 
(our unit of. analysis) at six different levels of .aggrt-gation: , 

. 1. Tfie 15 sites treated individually, ' ' \ ^ 

» - \ • — 

2. Various subsets of the 15. 

3, Tlie 15 aggregated.* ; * 



4. 1,7 Ohlo' prime sponsorships, on w^fiuih'we also iizve detaiJod. dnta, 
^aggregated. - ^ .Cr . ' I .. * ' 

5. The* 15 national sltea and 17 Ohi^ altes aggregated — a tctel of J2. 

: ■ ' a' " ' ^ • • • 

, ••^ 6. All FpouscJTshlps in the country * aggregate J ,(^'46 > ir Fx3ct7. 

Y€ar X977).. - \ ' ^ ^ ' ^ ^ 



♦ , We -used moxiy^ difrefent analysis tochtilques, lncludi-»f; regression , 
correlation^ cro:;s t^bulaftioh, inspect^ri ^of descrlptif^ statist^ci, nd 
Judcrtnents b^sed on field observations. The spec:*.fic Ceclv^-lqit^s ... .1 
any given portion* of the analysis will be specific^d In thn body c' Lk 
report. ^ . . ' 1 , 

SITE SELECTION -AND. DESCRIPTION . 

• Tire 15 sites vjere selected as a purposive sampi:: ol all prlfile 
sponsorships, • We "do not; assert that we have a samplp froiu which we caj^ 
gener^ize about all prime sponsorships in a strict statistical cense, 
Nevetthele3s, we did' select ^xime sponsorships in which we expected b^oad 
variation in the elemehts of their programs anJ management^in wh^fch Ve 
were interested {and we werje not disappointed in this expectation) • And 
w6 also planned- from the outset to use the 17 Ohio ppime sponsorships as 
a comparison grJjup. Those sites had been chosen 'Slimply because thfey, ware 
all in a single large ai^ diverse statue and could reasonably be exprcjt'^d 
to vary much ^ like- all prime sponsorslhips in the country, (This w^s au 
expectation that turned out to be largely supported by emp^^rical arfa?-jl!l^^8— 
see Ripley and others, 1^77), We also planned to compare the experience 
of our, 15 sites to* all prime sponsorships dn the country on some measures. ^ 

The criteria by which we arWved at tlj^ 15 sites can be siamnarlzed ad ^ 
follova: * 

1. G eographical spread . We wanted^at lecst pm prime spdnsorship in 
every'^ federal region and no more than twovin any l:egibn, ' 

\< Size of program ^ We elimina<^ ab^t 1A3 of all' prime sponsors on 
the gro»Ti<is that they were simply. jtoo small. We used an arbitrary Ifimit 
of $1 million for a base Title I allocation^ as our cutting f)oint. We 
also decided not to attempt any of the very largest i)rtme sponsorships in 
the country, ' Within the eligible range we^sou^t to choose sites. with . 
sul^stantial variation, • ; . * • 

3* Type of prime sponsorship . We wanted at least several examrles' 
each of consortia, ^cities, counties, and balances of state. 



4\ General* economic conditions . We inspectsd unc^iployment figproo so* 
t we would have ar range of prime sponsorships In terms of .general'oconpmic 



y. Ethnic Mix of Population , We inspected ^i^^urec cm perce^nt^.of 
non-white populati^Q nnd perrcrit of Spanish-speaking, population 00 that we 
Would have a mix of different ethnic characteristics. 



*6.. ^on-duplication of other Inte r slve f iel d sfv.c H.rg, .Wc decided 
to avoid ^uslng sites already used by the Na^tlonal Academy of Sclcncer* 
study (28 sites) snd th? Employment and Training Administration Itt-hc'-?,*^ 
study (66 sites). We also eliminated all Ohio prime spoTOorjhips siucc ' 
we had already riLudl(?.d them.. ^ • 

7. Repu tation for "general success We did not want prime sponoor- 
shlps that were so badly managed that all we could report wasf a lack of 
mana^e^nt decisions that were consclousJ^y alrafed at affe'ctlng program 
perfonrmce. On tTie othei: hand we did not want only the "best" f U-uia ^ - 
sponsorships in the country.. We wanted a bi:ocd variation *..n g';at:v:l 

« management rtyle, competence, and effectiveness cbc^a a Inv minlmi:a 
We also wanted' a broad variation j,n program perfciiaanpe measured in a number 
of ways. ' ' - 

In ord*er to help us screen out unacceptably urmnnajed prima cpcnoorshlps 
we used three pieced of evidence: 1) those rated "signif Icaiit under^^orior-' 
mers" by the Department of Labar field assessment in the spring of 
wore eliminated; 2) those rated "marginal" or "unsatisfactory" in tha 
spring, 1976, field assessment were eliminated (this left over 260 rated 
"satyis-f ^ctory") ; and 3) a few with special problems identified ly national 
ETA officials were eliminated. 

^ We u;^ed judgmental, information we solicited^ to get "po5;itlvc" 
nominations. Fits t, we talked \|lth appropriate ETA officlal;3 to get their 
impressionistic nominations. Second^ a Field Memorandum^ (180-76, liny 26, 
1^76) was sent to all Regional Administrator^ that first described the 
project briefly and then asked each of fhsm to nominate flva or'slx of tl^e 
"most .generally successful" prime sponsorships in the .region for. study. 

8. Willingness to cooperate at ^he, local level . r;<^'en the nature* 
of the recearch ve needed to undertake, It woiild have bvjca pointless to 
choose prisme sponsorships in which the professional staff would not 
cooperate. Thus we selected our 15 preferred sit^s on t^e Sasis of the 
above seven criteria and then made extended phone calls (preceded by 
written descriptions ol what we wanted* to do) to the tzhlef of staff at 
each site. On the basi3 of those phone calls we judged that t)iere would 

^e a high level of <fooperation at 14 of the sitec but that we ought to 
replace one of our fitlsrt choices with an alternate, which we )jlid. 

Table 1 presents summary information on region, size of program, and 
type of prime sponsorship for the 15 sited. Table 2 presents sunanary , 
inforaatibn on the population and unemployment ratef^ in the sites* 

oiRGMUZATIOn OF THE REPORT ^ 

Three major analytical sections follow. The flrc^L fo'-uses on program 
design and ffiatiagemen<. The second focuses' on program partticlpanCa* TJ-ie 
third focuses on' program performance. A concluding section a8scs3es r/aa 
findings aa a whole and also offers policy recommendatibni . ' 
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\^o ? 1: Region, Size of Progrcm, l-iq Type of Priuis Sponsorship, Project Sites 



/ " 


size of PiJgraa 
($ In millions) 

Title PSE ^ 


• 

Type of 
Prime 
Sponsorship 


• f 

Notes 01)* Nature of Prime Sponsorrr.i? 


Ccnnicticut Barianc3 of i^^ztc 


I 


8.9, 


12.9 


BOS 


' ' ' "' • " ' f 

Rural, suburban, small town areas. [ 




I 


2.0 


2 . 7, " 


Csrt. 


Cer.cral small city of Lowell (94,000) anci e^glft j 

surrounding to^vTSS. . ^ ' « ■ i 
^ ^ ( 


CccT'i^ ^:.ad'Cc. > N.J. 




1.2 


^ '—r^ 

1.6 


County 


Rural ajf^ small town areas/ j 


Yonkers, K.Y. ' | 


1:3 


1.6 


City * 


Moderate sized city next to New York City. j 


Wilnington, Del. j 


III • 


1.1 


0.9 


City \ 


Small city. 


1 Lucerne Co. , Pa. 


III 


3.0 


3,A 


County 


Small city vjOjUUU^ in a tieaviiy popui-auea ana 

industrialized^ countv. j 


i5i^inlut^*«ia iJi'ea Manpower / 
Csrt., Alabama 


1, 1 


A. 7 


3.7 


Csrt. 


City of Birmingham (301,000) and surrounding county 


Cumberland Co., N.C. 


IV 




0.8 ' 


County 


Small city (53,000) and its county. 


Duluth, I Jinn. 


V 


l.A 


0.9 


City. 


~ / 

Sm^ll city. . ^ 


Arlcat;^s Balance of St^te *: 


* VI 


.12.5 


9.7 


ROS 


Rur^l and small town areas. , ' 


Dallas Co. Csrt .1 Xsxd^^ 


VI ' 


2.& 


1.1 


ycsrt. 


Balance of suburban county surrounding Dallas city. 


(Jentrai x«^v;a Kegioa^^a_As^n. 
< of Local Governments 


VII 


3.0 " 


2.0 


Csrt. 


Eight couljiiies surrounding Des Mqines (201,000)./ 


Denver, Colorado 


. VIII 




3.8 


City 


Moderately large city (city and cj^ounty are co-^ 
terminous and are a single p;o^»^crrjnent) . 


^ 

Sacrananto-Yolo Csrt., Cal. 


IX 


^ 5.2 


6.1 


Csrt; 


Moderate sized city (257,000), its county, ani ^ 
neighborirrg" suburban and ril^o^ couifty. 


Klng-Snohoniish lloapower 
Csrt., Washington 


• X 


11.1 


11.9 


Csrf. 


Moderately large citf of Seattle (531,000), 
its countv, and neichborirg county. 



^^This figwe is the Title I base allocation for FY 77 announced on XO/22/76. ' ^ 

^ This figure Qomhinos the base Title II allocation ani.ounccd on ll/22/7€ a.:d tr^ lai'^. T^lle Vi i^cc^t.''. ^ announced 
on ■l</17/76^#^' 

. ' "I - f ^ , 

'Source: Office tff Inf ormatiow. U.S. Depattm'sni: of Labor. , • . . , ' / , 
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Tab].e"2: Popul'atica a.id Unemployment, Troject Sixes 





i :tr-l 


% Fconomically 
' jidvantaged 
. ia.ilies, 1970 ^ 


i 

% Non-\7hite, 

1970 ^ 


% Spanish- 
Speaking 

1970 ^ 


^ % Unemployed 


/iprii-.j une, 
/. 19^5 " 


April-June ; 
1576 . 


x976 


Ccnnec'icut 


1, 719,941 


4 .0 


2 


1 , 


' — • -1 

. 9.2,. - 


• r 

9.4 


8.2 . 




182,731 


6.1 




1 


12,>/ 


': 8.5 ' 


C.2 " •' 


CtiiEb: -Jlaiid, K.J. 


121 , 374 


* - 

- 9 2 


15 • 


6v 


14.5 


10 .'9 




Yonkarc ^ 


204,29? 


5.6 


. 7 - 


4 


' 8.4 i 


\ 8.5. • 


' 7.9 I 
1 


' J 

WilniM3oon 


80 , 386 


16 ;o 


44 . 


2 


-•1J.2 


■11.3' , 


10.9^ ' 


i -.uzerne 


342,301 


8.9 


.1 , 




11.. 3 


• 9.9 


• 10.3 


^irniinjham 


644,991 


14.5 


» 

33 


* 


6.6 


7.1 


6.0 


Cumberland, tl.C. 


212,042 


17.1 


26 


3 

» 


6.1 


■ 6.^ • 


- 7.6 " 




Ouluth 


100,578 < 


7-4 , 


2 


* ~ _ 




8.1 


6.3- > 




Arkansas 
• 


1,497,559 . • 


20.1 


19 


. ^- 4 ' 


9.4 


6.2 


5.6.^ 




Dallas 


, 881,547 


8.1' 


25 


9 


4.8 


4.3 


3.7 1 


Ce^gcal I ova 


502,206 


• 7.0 ■ 


3 


1 ■ . 


' -5.1 


4.9 


3.8 1 


Denver 


■ 314,678 


- . 6.8 


11 


15 


^.0 


7.4 




Sacramento-Yolo 


. 723,266 


8.9 


. 10 




8.7 


; ;9-.5 


8.8 ; ' 

^ 


Klng-Snchowish 


1,421,869 


5.2 .. 
. - ' . 


.6 


2 - 


.8.9 


j'8.6 


7.5 . 
^ 



^ Source: U.S. Departiaer.t of Labor. Fig'^^res are averages of the nonrth.ly figures for'tha aonths i-dicated. 
J lesE than 0.5% - . ' ' ^' 
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II. PROGRAll DESIGN AND M/ICAGEKENT 



Prime sponsor staff members have qpnsiderable latitude In designing 
and managing their CETA program, especially the .Title I jcomponent. In 
this .section of the report we want to analyze four major sets of decisions 
that are made. These dacisions are -about: 1) the mix of Title I, programs; 
2) major features^bf the local delivery system; 3) ho\; to manrff^e potCTcLai 
and actual -conflict; ^nd 4) how to seek the invo'lvement of busiacLo/s'^A 
organized labor in CETA, if at all. . g| / 

^12 CHOICE 07 TITLE I PkOGRAM MIX 



A Description of | the^ ChoiceS^ Made # 

T9 begin oul: analysis atid explanatlog^of tfie cl^anges in Title I program, 
mix over time, we want first to lay out some simple descriptive statistical 
summaries of patterns of utilization and preference for two sets of 
prime sponsors, the 17 Ohio sites we have studied and the set or,15 
national sites we most recently observed. -Figure 2 displays the average^ 
expenditures oa training (classroom and on-the-job) and ^employment (work 
experience and public service employment) programs for both sets of 'sites. 

Figure 2 displaya significant stability across time with some 
increased emphasis on training programs In late 1976-, The national sites 
consistently had a greater emphasis on training- than the Ohio sites* 

Table 3 summarizes the information on total expenditures for th^ two 
I'Vge^ categories of" programs for each of the first two full fiscal years 
of CETA and for Decjmber, 1976.,, Table 4 breaks the infotpaation into the, • 
four b^sic ptogramrn^tic categories and rep9rts the mean percentage 
expenditure for each prime sponsorship in each group. ' ^ 

. Tabii^.e 5 sum^arl^es the proportion, of clients enrolled in the two , 
basic kinds of CETA programs ih FY 75; FY 76, and as of December, 1976, for^ 
the Ohio si^os, for the National sites, and for all prime sponsorships 
In tlie countty. Both the national sites and Ohio sites have increased 
the proportion of their partic^lpants in training programs over time. 
All prime sponsorships in. the country increased that proportion between 
FY 75 and FY- 76 and it remained stable in Decembeir» 1976. The increase in 
the Ohio sites has been steady and has brought the Ohio primes to the 
natiqnal average. The increase in the national sites has also been steady 
and has lejft t'hem well above the national average for participants in 
trailing programs (and they have ^Iso been consistently higher than the 
Ohl^ sites on that figure), t 

To get some feel fpzL how closely planning and performance in terns of 
expenditures coincide^we inspected, data on percent of plrti achie^Ted for 
the total plan and for the major programmatic seg^*^.xts otaer than PSE. ; 
Table 6 summarizes data on the percent of prime sponsors in our tw</ 
groups of sites that achieved at least 85Z of ^\exi (a Department of Lf^bor 
standard) at the end of FY 75, at the end of 17 76, and in December, 1976. 



figure 2: Average Percent of Expenditures G9ing to^ Employment - 
and Training Programs 12/74^6/75, ^12/75, 6/76, and 12/76 
Ohio Sites and National Sites 



Percent 



70 
65 

55 
50 
45 
AO 



' 35 



30 



} 



Natiofeal Sites-r 
Training Programs ^ 



Ohl<3 ^lte6 — 
' X* Training Programs v 



,y: ^; 



^ Ohio Sites— 7 
^ Employment Programs 



V National Sites — 
, Employment Programs 



12/74- 



6/76 



12/75 V 6/76 
Quarter • " ' 



12/76 
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/ - .V : -'Jl fURES FOR EMPLOYtiKWT At^tj TRAlNItIG 
nAfiolMAL A:*J CH:o. SITES, FY 75, FY 7', -mcT]?//'' \ 



(In per cents) 



Type of Program ^ ^5 

National Ohio 



n 76 12/76 
National Ohio National Ohio 



Training 



53? 't6% 



55% 45% 



65% 



Employment 



47% 54% 



45% 55% 



35% 45%' 



/ . 



21 



V 



\1 



Tr.bMc -aV'^ -.T, •'J'^'^N) EXPLNDITURES FOR l-JPE OF PIO'^., M. 
NATIOKi^j, s;iTES /J R OHIO SITES, 73, IV Vc, and l-'//6 



r (In percents) ' 

A 

' ^ ? 






National Sites 


^ J 

• Ohio Slror. 


FY 75 FY 76 12/76 


FY 73 Tl 76 •1^/75 


^^^-1 ' • 

Classroom Training 

OJT ^c^m:^ 

\ 

Work Experience • 


A2% Al%' 51% 
^ \\ 14 1^ , 
5 8 5 
' 42 37 29 


37% J<;% 43% 

9' .10 12 
'9 10 14 ' 
♦•45 . ■ 46 ■ 31 
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T/jie 4\ par: T.dlPAJIT ElsT^CLUlZNT IN EriPLOYMENT AliD TRAININQ-PROGr^vG, NATIONAL SITES, OHIO SITES, 



riTaining 



Employment 



iJTD ALL PRII'lE SPONSORSHIPS, FY 75', FY 76, and 12/76 



*^ • (in percent"?) v 



FY 75 



12/76 



Typa . £ Frogram National Chio All National Chio All - - National • Ohio All 

Sites Sites Primes Sites Sites Primes Sites Sites Primes 



UlZ 
59/ 



35% 34% 



65 



66 



50% 
50 



56 



51 



y 



'44% 49% , ■ 60? • 49% 48% 



40 



51 



52 



23 
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•The data for December, 1976, may not be fully comparable Jn tihit pr:.aion 
may not plan af^ carefully from quarteif-to-quarter as t^ey do for the rnd 
of a fiscal year. On the other hand, gl^ven tbfe modification procesn cpen 
to them, ^hey era t jilor plans to Actual performance in latet quar^zurs aud . 
so pethaps mic-yoar dajta such as Deceicber, 1576*, are also revealirg. • ' ' 

Table 6 sug^^ests several thiKg^. First-, the national sites pre | 
not notably "better" at*manageinent maasured In this way than the Ohio gi^tes^ 
even though the former were chosen in part because they were thought to j 
be "generally successful'" and the latter were chosen simply becavn3 th^j 
all hap|)ened to' be in one large state,. Secoird, there are fluctuation! In 
,the achievem^t of plan in all categories^ but both sits of primes ^tcv* , • 
clearly been having the most trouble in meeting their OJTrgoals. ih.ls 
is understandable since^ spending OJT money requires the agreement of an 
employer, whereas ^spending money for classroom' train ui^ or, work experience 
simply involves an act of will on the part of the prijie sponsorship aione, 

fecpjaining Program Choice 

* We observed two general phenomena related to program choice that we 
tc-ied to explain: change in program mix and differences between programma- 
tic emphases in different prime sponsorships. 

Change in Program Mix . There is an extensive, literature that argues 
that program choices (including budget choices) are basically incre:nsntal, 
which means that 'Change occurs. in small increments and this year's activities 
can be explained almobt totally by last yeaf's activities. (See Davis, Demp- 
,ster, and* Wildavsky, 1966, for a. classic statement about budgetary incremen- 
talism and Braybrooke and Lindblom, 1963; and Lindblom, 1965, for- classic 
statements of incrcmentalism in general. For empirically based criti-queis of 
budgCitary increir.entalism see Gist,* 1974; Natchdz.and Bu^^p, 1973; and 
Ripley and Frank] in, 1975.) The ipcrtimental line of reasoning asserts ' 
that because of limitations in the availability rnd accuracy of data, in 
the time available for analysis, and in the ability of decision-makers to 
predict the coiisequences of major policy change, yrogrammatic decisions 
tend' to result in minor variations on past actions. Change comes about by 
adjusting components of a program at the margins through a series^f minor 
alterations that seldom reorient or rework a policy or program completely • 

When, this reasoning is applied to CETA it simply means that, if* true, 
program mix in a prime sponsorship at any given time will be a function of 
pri^r- program mix. 

To test this view we examined the relationships between actual program 
expenditures in FY 75 and FY 76 and the relationships between planned * . 
program expenditures for FY ^5 and FY 76 in the national sites. Table 7 
reports the simple correlations obtained. 

* * 
^ The relationships are strong, although the sinple sta^stic used may 

well mask important variations within program components, ^t is interesting 

to note that particularly for the two types* of training programs the^^ was .\ 

higher correlation ^between actual expenditures than between plana. > 

Althmigh strong, these relaticnshlps still leave considerable change 

unexplained in the statistical sense (somewhere betvreeti 10% and' 66%, - 

depending on the individual case) . Thus ft is clear taat prime sponsorships 



Table 6:" PERCENT OF PRIME SPCNSORSf ACHIEVIWG 652 OF PLAKNp EXPgNI/i- 
, TI.'RLS, MTIONAL SITES, A^ID OHIO SITES, 
' ' ^ .' FY 75, FY 76, .ind 12/76 



Segment*! of Plan 



tiatlonal Sltea 
FY 75 FY 76 12/76 



Ohio Site? 
FY 75 FY 76 12/76 



Total Plan 


71% 


87% 


—f 

67% 

i 


71% , 


65% 


64% 


Classroom Trainings 


50 


73 


: 80 


- -50 


59 • 






• 14 


53 


40 


■- . 29 , 


29 


'64 


Wo^l^ EKperlenc. 

h 


71 


80 


53 


50 


71 


64 



\ 
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Tab^e 7: 



RELATIUNf/tllPS BETWEEN FY 75 and FY 76 EXPENDIXUHES AND VUM'.ZD 
EXEEMDITU9ES, BY PROGRAM SEGMENT, NATIONAL 'SITES 



Correlation bet\7G4n FY 75 Cdrtelatlon berwe^cn FY 75 
Expenditures and FY 76 Planned Expenditures and 
Expenditures FY 76 Planned. Expetfdltures 



Program Sepient 











Classroom. Training 


.78 




- .70 










. .93 


• 


.58 


PSE 


.83 




36 . 


Work Experience 


.80 







at^ doing wove tljan just extrapolating from last years' plan or 
- expen4itures In planning for the future and In spending for their progt^ia-., 

They setn to be naking deliberate changes that do not escape the Impact 
*x)f the past 'but are far from totally determined by It, 

We hypothesized that some specific features might Increase the amp'jnt 
of change In individual prime sponsorships. Specif lcally» we felt that ' 
t^ose prime sponsors that retained, soice of. thei1> Title I programs for 
in-»house delivery would /exhibit more change because of Increased - 
flexibility. We also felt that those prime sponroorshiiTs with high <iut^lLf7» 
monitoring and evaluation would exhibit: more change becauca thoy uouJ'i havo. 
better "feedback" on which to make subsequent adJpsUrants. We als/> felt 
that those prime sponsorships in which the quality of the top staff was 
relatively .bigb v/ould exhibit more change because we osstrned that the 
better plomltig of which thesje staffs seemed to be capable would probably 
result in larger changes . We also felt that in those primes in which f 
service deliverer Influence was perceived to be relatively lo*^ ther^ would 
be more change because there would be less entrenchmcut^jushing for 
continuation of-programs with minlaial change. ^ 

> - We employed a partial correlation technique to test for the above 
relationships. In fact, none of' them altered the basic simple correlation 
by any notlaeable amount. Again, our statistic^ !r?y be too blunt to reflcsCt 
intportant variations in planning and spending within the program segments. 
Thus we do not* read* the results as a denial that the above factors are 
Important, rather that they do not appear to be ir^ortant at the gross 
level of the four basic segments. An alternative argtiment,^f "bourse; is 
tliat £ood, manager»ent in many cases may result in a conscious/ decision to 
change plans and expenditure^ very little. ' Change may or may not be 
warranted in any |lven Case. Good management comes in knowing when the 
deciclon ,to change is superior to the decision not td chaug3 and vice* versa 
Certainly, .correlation coefficients cannot make that discrimination no 
matter how J.ong and carefully they are, massaged. ' . 

Choice of Programraatic Emphasia ;-, One l^^slble explanation for the 
^^differences- in" program nlx*'ln our, 13 sites is that mr.hpowet: actors 'in -those 

sites have different preferences. We asked a varlfety of actors (staff 
fi members, planning council members, end service dnl^,rerers) to rank order 
th^ir preferences for broad progr^ categories under ideal conditions 
and given present clircuinstances, with a rank of "1" assigned to the most 
preferred program and a rank of "A" assjfgJjied to the. least preferred. 
(Insufficient data in one of our sites limits our analysis to 14 cases.) 
We then computed an average 'ranking f^ox each prcgiam In each prime 
sponsorship.* We^ also computed the average response across all 14 prlmd 
sponsors. The results of this final confutation are presented in Tabljs 8i 

^ . Table 8 shows^that fpr both questldns, O^T was the most preferred 
ptograta, followed b}^ classfopm training,* work experience, and PS^' in that 
order. Thip .^ly difference resulting from thfe explicit recognition of 
the limitations imposed by present circumstances was a slight downgratfii^S 
^ of OJT ^nd a similar rise in' tRe PSE ranking. Standard deviations werd" * 
generally low, indicating that there was .Substantial agreement on the 
rankings among the various prirae sponsorships. . 



^ Table 8: A'.TZPJi.OE (MEM) PREFERENCE' OF ACTORS FOR TYPE 
OF TITLE I PROGRAMS, 14 MTIONAL SITES 



Type of Proeran Preference under jt" Preference under . 

^'^ * Ideal Conditions Preqont Circumctniccj 



Classroom Training 


2 .2^ , 




2.24 




Work Experience 


2.61 




2. '67 






1.75 




1.96 




PSE (Title I) 


3.^4 




3.01 


* 



The data reported are mean r^Ssponses on a 1 (most desirable) to 4 (least 
dea^-rable) scale. 



^'Despite this general agreement, it Is possible that the moclegt * 
disagreements betiv^^en the prime sponsorships in their attitudes tcc.^.rd 
this issiief might help to explain the differences in their progreim mi-jivjs- " 
In bur Ohio study we found that such preferences proved to be an ir^ortant 
explanatory variable. Table 9 indicates that to some exL<int prefercacca 
are Important in the national sites as well." 

^ thlf table we correlated the data on V^eferences with FY 76 dht * 
on exp^ndi.tufes • We report the association in the form of Pearson's r.^ 
The most interesting feature of the tabie^ls that preferences under present 
circumstances are In *e very case more hf^ly related with .actual spcuJllrtj 
than preferences jinder ideal condltioi^^d. Local coridltlons ("present 
circumstances") probably both impact on preferences and also reflect 
preferences* This relationship runs l|i both directions, but the figurea 
in Table 9 give at least some supportj^o the view that actor preferences 
are acc6mod|itedy esi>ecially in the cases of ' OJT and work experience* 

St ' ' " ' ^ 

A second possible explanation for the differences in program mix Is 

variation In local economic conditions — especially unemployment and 

general fiscal health of the governments in the prime sponsorship. We used 

monthly data On unemployment in 14 of our 15 national sites end judgments 

•about fiscal conditions to explore this relationship. ^ 

We anticipated that OJT would decline substantially with high 
unemployment (because of ^ reluctance on the part of employers toVagree 
to bring on new employees) and that .classroom training, would decline 
moderately > (because of the increased difficulty of placing graduates) 
Work experience and PSE would be expected to increase. They would talce 
up ^he^Slack caused by declines in the other programs and \JouJ.d serve, as 
a source of income' for participants, many of whpm would have little need 
for training, havlng'*'been employed prior to the recession. 

We computed correlatiqns between the unem|S.oyraent rates for the jTeriod 
^October --December, 1975 and program mix in FY 1976. The results were- 
directly contrary to expectations, although the relationships were weak. 
Unemployment. was positively correlated with training programs and - 
ne^attvelyXcorrelated with employment programs (see Table 10) . The 
unexpected Results may stem from other factors, including past program 
history. This /:ross sectional analysis merely relates unemployment rates 
to sizes of programs i It does not indicate to wh^t extent program size is 
the result of unemployment rates, since it does, hot controi-^f^r*the impact 
of bther variableo. ' - ' 

. 4^e performed another test in which we tried to determine whether 
changes 'In unemployment rates were relat'^d to^the predicted changes in 
programs. In this way we hoped to limit the effects of other variables. 
The change in unemijjoyment rates from January - March, 1975, to January - 
March, 1^76, ^was correlated with the change in program mix from FY 1975 to 
FY 1976. The results were somewhat more in keepirig with expectations 
(see Table 11).' OJT was negatively related to unemployment (-.37) and 
there was a V^ry weak positive relationship between wolrk Experience and 
uhemploym^nt. But the relationships with classroop training and Title I 
PSE tBrere not expected. It seems fair to conclude that prime sponsors 
did not uniformly respond. to unemflloyment rates in the way that we had 
anticipated. * 
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Tabid 9; REIATIOMSHIP BETWEEN ACTOR PREFERENCES AND EXIEKDITUPjES, 
BY#rnQGRAiM,. NATIONAL SITES, Fx' 76 - 



TyRe of Prc^r.im 



Preference under , Preference under 
Id^al Conditions f PresdWt Circumstances 



classroom training 


-.19 


' .02 


Work Experience 


-.08 


.32 


OJT 


.34 


l53 


PSE (Title I)^ 


.09 


.21 

^ 4- 


The data reported are Pearsou's 


r's, 








% 
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Table 10: RELATION BETWEEN UNEMPLOYMENT (Oct-rWc^', 1975) AND PROGRAM 
EXPrHCTTJRES, FY 76, NATIONAL SITES, BY TYPEOF PROGRAM 



^- ^ Type of Program 



•/ 



Correlation (Pearson's r) 



Classroom Training 

PSE (Title I) 
Work experience 



.29 
■ .34 
-.10 
■ -.45 



\ 
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■/-Table 11; REUTION BETWEEN CHANGE IN UNEMPLOYMENT (from Jan. -March, 1975, 
to Jan. -March, 1976) AND CHANGE IN PROGRAM EXPENDITURES • 
(from FY 7? to FY WU NATIONAL SITES, BY TYPE OF PROGRAM 



T^e pf Prog rata 


Correlation (Pearson 'd r) 






Classroom Training 


.11 


OJT 




PSE (Title I) 


-.28 " , 


Work experience 


.11 ■ 
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For both of the teats reported in Tables 10 and 11 w<2 also produced 
partial correlations by controlling for location of oporatlng r«f;pon^5bi-* * 
llty,' quality of monitoring, quality of evaluation, percr.ived quality 
of top staff, and dogrce of service deliverer influence. But, as wi.lh 
the application of these controls in assessing change, they did not '»"e^3uic 
In any Important changes in the basic relationship' ri^ported by the simple 
correlation. ' - ^ 

' These mixed findings abput the impact of unemployment are consistent 
with our observations during field work for the last three years. Tlier? 
is no agreed on "best" way to respond to ij;icrea8ing or decreasing upoiiiploy- 
'ment in programmatic terms. ^ Soipc argue that training should b6 incrc^ascd 
during a recession to prepare participants for the next untum. Othsrs 
arcue thct- it is foolish to^ stress training during periods when jobs are 
scarce and the refore> they push for increases in employmen'^ programs. 

• These differing economic ideologies are reflected in ouSL^sltes. Thuc, 
given that different professionals react in different ways by choice to 
the same conditions, mixed or relatively low relationships are, not 
surprising. The staff has a relatively high degree of control over — 
expenditures on classroom training and work experience* Thus, ,s|bce thejj ♦ 
are deliberately reacting differently to changing unemployment, /the weak 
relationships reported in Table 11 make sense. The staff has relatively 
less control over spending on OJt», since that' also invc^lves a conmltment 
by an' employer. Thus the stronger negativg correlation reported in Table 
11 suggests that it is the programmatic segment in which^ changed In th$ 
unemployment rafe is likely to have the strongest impact. But ^ven In 
that segment of the program the r^ationship explains less than 15% of the 
variance. All of these findings underscore the nori-determinlstic nature 
of economic condition^ in relation to program choice. ^Manpower staffs 
have a great deal of latitude almost regrrdless-of the local unemployment 
picture to ehlft^^eir prograiaaatic priorities in ways they deol'/:a. 

ihey may be under other, more severe constraints, such as basic facts of 
ccnmunlty p^itical influence, but they cannot plausibly argue that 
changes in unemployment make shifts in programmatic emphasis inevitable 
despite their contrary preferences^ Some marginal changes may, of couri:."i; 
be warranted in response to changing conditions, but there is debate over 

• vjhat changes tiake the most sense. 

In ad-iitJcn unenplo^-went we alao looked at rhe relationship betver-.n 
perceived genera ». fiscal health of priao sponsorships and broad programruaclc 
choices. The .on.'.-' expectad relationship was between fJpcal, health and the 
use of Title I money fcr PSE slots. We expectel that relationship to be 
negative. had no reason to expect that any otiier relationships would 
appear. When we correlated our judgments about fiscal health with spending 
by program segment for both FY 75 and FY 76, in general our expectations 
of weak, random relationships were realized. The relationship betweeji 
fiscal health and PSE spending ^n FY 75 was none5cistent a.id was mildly 
positive (.30) in FY' 76. If anytMn^., Title I spending, for PSE was a ^ • 
little more likely to occur in fiscally healthy prime sponsorships. 

Oiir expectation, about PSE and^ fiscal health came from our Ohio 
study. In Oh^.o a number Of prime sponsorships in fiscal trouble had 
reported to spending Title I for PSE as another method of keeping the ' 
governmental payroll from shrinking. Our national sites c'id iiot engage In 
such behavior.- The few Title I PHE prograihs that exlctcd were generally for 
creating nc^^ positions for the tdisadvantaged and trancitlon to pennaTiencc 
was jquite high. 
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ADMINISTRATION OF TllE^LOCAI. J^LLVJT.Ki SYSTEM ' ^ . 

There are a nutnber of Important chplces that help shape- the type 
of delivery s^^stem developed by" any prime sponsorship. Thesa^ include 
'basic operational atxangements (the degree of administrative integration 
'of the programs under different CETA titles, progrananatic integration^ of _> 
all segTarr'-G of the CETA enterprise, and the allocation; of operating 
responsibility); the method used for selecting service deliverers; tlie 
nature of program mpnitoring; the nature of program evaluation; and the use 
of ^the Employment Service ih CETA. ♦ 

*Baslc Operational Arrangements 




7 - » • ^ 

The Administrative, Integration of the Major CETA Titles . Six of our 

national CETA sites had a high level of administrative Integration across * 

titles, there wexie no separate staf£ units for separate titles;^ the staffs 

were organized by function regardless, of title. Nine prinfe sponsorn'aipa 

choSe to operate with a low level of administrative intngration, usually ^ 

with a very separate and distinct PSE staff unit. When the six with 

relatively high administrative integration are compared to the nine with . 

low integration it becomes appai^ent that high integration is more likely 

in prime sponsorships with 1) a more open CETA decision-making system 

(not completely dominated Just by profess^ional staff aijd political 

officials); 2) a lower unemployment rate (and, therefore, a relatively 

smaller amount of PSE money); 3) greater staff independence fnSm political 

officials; and 4) a higher commitment on the part of the political 

officials to serving <iK)re I disadvantaged persons.. 

4 f 

The level of integration is, of course, not coSipletely within the 
power of staff to decice. In factT^in many jurisdictions the decision . 
aboift whether to separate Title I and PSE admlhistratively was made by 
^ political^ of ficials and their closest advisors at the beginnfng of CETA 
and has ^^raflt really been open to' question since. / 

Programmatic IntagratJon . By programmatic integration is moant the 
degree to which CETA participants are able to move bctw3en different 
Title I prograi^s or between programs funded under different Title^. This 
type of integration is much mc^re opeh to ctaff manipulation and cnange 

than is basic administrative integration. ! 

' / ' . 

In the 15 sites^^^ly one had a high degree of programmatic 
. integration. Six mode had at least some elements of integration. Eight 
had made virtually no attempt to achieve programmat^^lc integration* 

A higher degree of pro^raimnatic integration is mofe likely to be 
"present in those prime sponsorships in which the staff has a^Kighcr degree 
of independence from political of f iclals<and in smaller single city or 
single county prime sponsorships. Larger prime sponsorships and consortia 
often elect to avoid progrartmatic integration to simplify admin iotrat ion 
of what is a very large and potentially very complex program* 

Prime sponsox'ships more heavily committed to training programs ^ , 

(classroom training and on-the-job training) rather thaw employment programs 
(work experience and PSE) with Title J. are less likely to have programmatic 
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Integration. Likewise, thdde more comnitted to involving business in * 
CETA are less likely to have programmatic integration than those less 
committed. Theoe a&sociation3 seem plausible for two reasons. First, 
the training programs and the commitment to business involven^entf are both 
aimed at producing unsubsidized Jobs for Title I clients. If this effort 
is successful there is little reason to think they .would need to move to 
a Title I employment prdgram or^ to Title II or Title VI slot. Second, 
since Title I employment programsi are v^xy similar to PSE programs it is / 
not surprising that those with a greater involvement in t^e former would 
also have greater programmatic Integration between titles. 

Prim^ spon2|ors with higher programmatic integration tend to t^ave 
manual Management Informatlm Systems (MIS) rather than automated systems. 
This ia largely a function of the size of the prime sponsorship. Smaller 
primes are more likely to have both hi^er program integration and manual ^ 
MIS systems. ^ ' 

In some prime sponsorships the staff tends to view PSE programs as 
either "tainted" politically or as illegitimate manpower programs. VThere 
those attitudes prevail there Is less likely to be any programmatic inter 
gration. 

Operating Responsibility . Nine of the national sites contracted 
for virtually all service delivery. Six retalfied at least a considerable 
portion (and, in two cases, virtually all) of their programs for in^house 
operation. * 

The division 8f operating responsibility is related more to one central 
historical fact than t^any thing else« Priftes that had a large ^npmber of 

^ experienced manpower offiverers operating categorical programs when jCETA 
began were very likely to contract out all or most of their programs. 
Once the deliverers made the transition to CETA then they helped generate 
a decision system that helped perpetuate their role in the system. Thus 
those primes with a high proportion of service delivery under contract 
also tend to be those in which service deliverer Influence is relatively 
high, in which the decision-making system is relatively open (usually to 
service, deliverer influence through the MAC), and in which politiital offi- 

' cials are aware of the 'costs they might incur if they allowed impoVtant 
contractors to be cut severely or deleted from the system. 

The Selection of Service Deliverers \ * ^ » 

It is well established that the selfCtioft of service deliverers Iri the 
first few yearfc of CETA often represented highly political choices (see 
Mirengoff and Rindler , 1976; Mirengoff, 1976; and Ripley and others, 1977). 
^That point need not be reargued. Nor. need it be argued that when scarce, 
resources are to be divided, choices bfi(bed partially on political ^ 
considerations are virtually Inevitable. . • 

What can vary, however, is the degree of politicization of the choices 
made. Some observers have argued that one good way of reducing political 
choices and increasing program performance-oriented choices is to adopt 
a version of a request-f or-proposal system for choosing deliverers. 



Seven of our 15 kites did not use any form of RFP. Of tha eight who 
used an RFP in coma mode, two "used a formal RFP for the entire system, 
five u&ed a forn:al for some program components, and one used an inforna.1 
RFP for the complete ^system. The^ise of an RFP was more likely^ in larger 
ptlme sponsorships in terms of population and in consortia*. Only t*o of 
the nige non-consortia used an RFP of any sort. 

RFP's were also more likely to be used in primes in which the 
relative commitment' to training programs under Title I (as measured by 
their allocation of funds between draining programs and employment: programs) 
was high. This seems reasonable, given that those staffs most commitwad 
to training programs are also most likely to worry about costs, efficiency, 
and other aspects of "rational" administration. Their costs are also, more 
visible to the Department of Labor since the cost of a classroom training 
»slot is typically much higher than the cost of^a work experience slot. 

There Is good evidence that a relatively active- MAC is as£ocia*-:id with 
the* use of 'an RFP; In our national, sites none of ' the four w^.th an inactive 
council used an RFP. Eight of the 11 with a relatively active council 
did use an RFP. The direction of causality is not clear. It may be that 
a prime sponsor staff simultaneously made the decision to seek an active 
council and to institute att RFP system. Or It may be that the council 
itself pushed for the development of some^ form of RFP system so. that it 
would have some relatively clear criteria to use in giving its advice on 
deliverer decisions. It certainly makes sense that if a council wants 
to have genuine influence in the selection of deliverers thaf it would 
find the infomlatlon generated by an RFP easier to deal with than 
information likely to be less structured and more amorphous In the absence 
of an RFP.^ And, in fact, in those instances in which an RFP is used, 
th^ council is also more likely to be perceived as very important or 
important In the selection of deliverers and in making Title I program 
decisions than if no RFP is used. 

What differences in perceptions by the actors of different facets of 
CETA decision-making does the presence or absence of an RFP system make? 
We probed for evidence on this question in our interviews. The general 
answer is that thus far the use of an RFP has not made a great deal of 
difference. We would hasten to add, however, that.l) there are some small 
differences that are suggestive and 2)^ in most areas the RFP was quite new 
and so may not have had fiuch impact on perceptions as yet, even though 
such impact may be forthcoming in the future. 

Thus far #bout the same proportion of actors in both the RFP sites 
and the non-RFP sites assumed that service deliverers would 1)e refunded. 
The existence of an RFP does not seem to have cut into the general presump- 
tion that those deliverers in the system will remain in the system. * 

« 

There is some evidence that the presence or absence of an RFP 
lias had some marginal impact on the perceptions of actors about why 
deliverers were chosen* . In interviews we asked actors to indicate the 
presence or absence and the importance of six possible reasons for choosirg 
specific service ^deliverers. We also asked them to name the single most 
important refison. The six choices were: 



The alxsence of alternatl^^e deliverers. ^ 
P»ior decisions to serve .particular client groups. 
Economic conditions in the prime sponsorship • 

4. Political considerationjB associated with an agency. 

5. The quality of the deliverer's previous performatice. 



f . Pid^&Lce and guidance from the Regional Office of DOL. 

When the an^v7ers are ranked by frequency of "yes" responses for primes 
with RFP systems and those without RFP systems only a few differences^' 
emerge.. Table 12 suninarizes those responses . ^ol it icdl considerations 
come out about the sane. The most important cUfference is that previous 
performance is cited much more frequently by actors working in an RF? system 
than -those working in a non-RFP system. This at least gives a hint that 
the prese nce of some form of R?T Is contributing to perceptions of 
"rational" decision-making. 

When the single most important reason for service deliverer choice 
is analyzed, serving particular client groups is the most important iri^ 
those primes with an' RFP. Political considerations are cited as the second 
most important reason. In pjlines without an RFP,, political considerations 
are named most frequently. Perceptions that political choices are important 
are present in all prime sponsorships, but they are* perceived as marginally 
more important: in primes where an RFP is not present. 

We aloo probed for the level of satisfaction with the process of 
choosing service deliverers on^he part of actors. Those actors in » * > 
systems with an RFP system tended to before dissatisfied than those in 
systems without an filFP. At least three reasons seem to explain this diff- 
erence. First, in most areas an RFP system is relatively new. Novelty 
is always a threat to stability and may well raise levrls of dissatis- 
faction, at least in the short run. Second, particularly if the RFP is 
quite formal, elaborate, an<} frequent, the consumption of time and> energy 
involved in uolng it and making decisions on the basis of it may cause 
dissatisfaction. Third,- it is pbssible that trfe use of the RFP has forced 
actors to think in a critical way about their goals and about means for 
attaining those goals. Such critical thinking may well raise dissatis- 
faction in general. But this is a "good" form of dissatisfaction in that 
it is occuring in the context of increasingly self-conscious, goal oriented 
decision-making . 

Program MonitorinR and Evaluation ^ ' 

Monitoring . On the basis of our observatigns of .both extent and 
quality of monitoring we ranked the 15 sites on a nominal scale of high, 
medium,- and low. Eight engaged in a high level of monitoring, five in / 
a medium level, and only two in a low level. This* ouggesls that a reason- 
ably serious approach to monitoring is defined in most instances as an 
integral part of CETA management. 



Table 12: FREQUENCY OF ACTORS' PERCEPTIONS OF PxEASONS 
FOR SERVICE DELIVERER SELECTION 



Frequency 




In Prime Sponsorships 
with RFP 




In Prima Sponsorships 
without RFP 


Voat aftett cited 


1. 


Serve particular clients 


1. 


Serve particular clieir^ts 




2. 


Previous performance^ 


2.5 


No alternatives 

ff 




3. 


Political consideratiocB 


2-5 


Political consif^^iration-^ 




4. 


flo alternatives . 


•4. 


Economic conditions 




5. 


Ecqnomlc conditions 


5.'' 


Previoiis performance i 


Least often cited 


6. 


DOL guidance 


6. 


DOL guidance 
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Evaluation . We also made judgments about the extent and quality of 
evaluation In our 15 sltes,.^d divided the 15 sites Into high and low* 
Seven were In the former category and 8 were In t^e latter category. 

The pilescnca of evaluation Is associatcrlwlth four other factors. 
Flrqit, evaluation Is more likely In |)rimes In which conflict In the systCTB 
Is relatively low. There are two pla/islble explanations for this. On 
the ofie hand. If coping with conflict takes up a large portion of staff 
time It may be that evaluation Is perceived as a luxury and/or as too 
threatening to Institute. On the other hand, the lack of evaluation (vyhlch 
Is often tied to an open decision process in which evalustlon rcsult^^ 
are pLubllcl;5ed) may contribute to a high degree of conflict because ^f the 
suspicion bred by closed systems In which decisions are arrived at .on dn 
unknown information base. ^ ' > 

»• 

Second, evaluation occurs in prime sponsorships in' which the staff 

is generally using high quality information of all kinds in making its 

.decisions. 
♦ 

Third, evaluation is n^st likely in those primes* with the strongest^ 
monitoring systems. ^ — 

Fourth, evaluation is more likely in systenis in which all service 
delivery is contracted out. Self-evaluation of in-house delivery Is rare. 

Evaluation and Monitoring Considered Together . -We merged our separate 
judgments about monitoring and evaluation to t)roduce a single evaluation/ 
monitoring scale. Four sites ranked high on thl,s sc^le; six ranked m3dlinn; 
and five ranked low. The same four factors Bssocla'ted with a high degree 
of evaluation vere associated with high placement on tjild scale. In 
addition, primes with manual MIS' s were more likely to rank higher on the 
scale than those with automated MIS's. This does not a'rgue, against the . ^ 
ultimate utility of automated MIS *8. But it does point up the necessltf^ 
of a staff bfelng ready to use the results of automation in a. meaningful 
way. A staff that thoroughly understands and uses 4 good manual MIS «ystcn 
can engage in more effective monitoring and evaluation than a stafi 
confronted with a cot^icated automated MIS that*no more than a few peoplt? 
undey tand and c^ manipulate. 

\vi general, when we related the degree o^ ev^iluation and monitdftlng 
present to the degree of budgetary change -for serv^ice <^eliverers between ^ 
FY 76 and FY 77 it appears that monitoring and evaluation are not use^i. 
to justify cutting deliverers* budgets signiticantly (defined as mor^thaK 
15% change ih on4 year). ^In fact, primes that. ranked low on monltor^g 
alone and o^ monitoring »d evaluation combined* were th^.most likely to 
cut their deliverers. Thpse ranking low on. wlie 'i^valufition scale alone 
vjre the most likely to be unstable—by granting large increases and by 
making large 'cuts. Conversely, those V^^I^s high on the monitoring scale 
wre the most likely to increase deliverer budgets significantly. Those^ 
ranked medium on the combined scale, when contrasted tcJ thoSB ranked low, 
.were most likely to grant increases. And those high on the evaluation scale 
alone were most likely to make only marginal budget thatlgeft 'for individual 
deliverers. Thus, deliverers cannot rationally fear incr'^ased monitoring 
and evaluation^^In fact, increases in both tends to bring either stabi^ty 
to the budgeftary decisions in ^the system or Increases to existing deliverers 
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Pre*Limably these decisions are better justified and nore rational" bocauso 
of the exi«tem:e ol good mohitojrlng and evaluation. 

> 

Use of the Erjplc 3 "in£nt Service In CETA %" ^ % 

' Nine of our 15 sites rely* on the Employment Service for Important 
segment? their Title I programs. The other 6 sites make only mo<lerate . 
to low use of ES. . 

TThen budget* change' Is examlne^'Tor those sites using ES sevrvjti 
pattewis become apparent. Firsts there was relatively lltila "int ^ 

change (defined es more than 15%) bet\^e^n FY 75 and FY 76, aad vh.^t^ 
,s#t3niSJtcant change did occur was usually In an Increasing direction. 
Sec^Bj^here was more chatige between FY, 76 and FY 77 — about hal,f rejnalned 
relat^ely stable and about half changed mo'i|^ than 15%. Ofifc thos^ chaiig-^^ng 
there was close to an even balance betj/een those Increasing. (3 cases) 
and those decreasing (4* cases). Thu«, overall, ES has retained Its ^ 
importance at these sites but prime sponsors seem more willing to loake 
negative Judgments in budgetary terms when they think they are^justlf lei. 

Several f^ors ate* associated with a larger role for' ES . Such a 
role is more likely in primes that are larger in pUpUlatlon,, have an open 
decision-making process^ have jpolltlcal of flclals with a relatively 
strong commitment to joB placement.' 

Perceptions of ,ES performance by actors in the systems are mixed. 
Over time it seems that there has been a small shift toward ^ore favoi;^le 
views of ES . / , . ^ 

Ji-Then asked why was chosen as a deHve^er, three reasons were cited 
most often: the atsenc^ of alteVnatlves (ES has been large and important, 
for mcny decades and is an obvious rep<)sltory of manpower ^experience 
and maybe expertise); the quality of its previous performance (some actord 
are quite pleased with the performance they have ,ob swerve d) ; and Departmen^. 
df. Labor guldante ',(thg continuing campaljgn by DOL to persuade primes to 
use ES). 



.ST^FF MANXGEKEST OF CONFLICT 



,In this sfectionr^ife Shall analyze the ♦conflict that has occurred * 
in thf fifteen n^tionflfcl sites and staff efforts to deal with conflict* 
'We sliall attempt to ch^uracCer-lie /the ^fonf llct thatJ^we have, observed and 
s^ek to.eiicplain its rodts. Similarly, we shall attempt to Isoli^te the 
factors that are related to prime sponsor strntegies for 'dealing , with 
* various actors. shall not attempt to assess the results of corf 1 let or 
vthe results of prime sponsor strategics. Those tasks are reserved for 
a later s^ctioa of this report. 

By and larg^, dbnfl^ct wat a serious problem in dur national ' 
sites; CETA.-was not the subject of elt4ier loud or contimting public dpbata. 
What ^conflict did exist tended to cei>ter on the funding of service 
deliverers or th^ related question of the locus of authority for naklng 
service deliverer funding declslon«. By comparison, the more abstract ^ 
-qlie^ticn of program choice received very little attention. Even t\\j ^ 
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question of the distribution of services among various 'cdrpiunlty grbupa. 
(minorities, woa^in, and so' on) received little atteQttpn, 'except wHen 
segments of the comtauaity objected to a setvice delivery fdnding decisloa 
that was Interpreted os having ethnicx overtones. 

^ If the intent of the legislation was to encourage discussion of^^the 
proper diPtrlSutlon of resources among, groups via the mechanism -of-rthe , 
planning council, then that intent has not been fulfilled* Debate cehtets'" 
Ground thfe choite of service deliverers and other Issues are aired on]y ^ 
in that context, if at all. Consequently* a staff that is imwlU.'uR no 
endure some degree Of conflict will probably^ be unable to effect ch^x.s<I,i 
in its prlmejppnsor service delivery system because that sort of initiat'i*'S 
is most lljcel^ to' lead to confllfct. ^ . 

The primary measure of conflict to be used In the following analysis 
rests on the judgment of our field research teams assigned to the various 
prime sponsorships. Each team tanked its site on a five point scal^?* rangln^; 
from high conflict to^ow K:onf lict . Eight of thfe 15 sites were judoed 
,to exhibit low confliR^ five were ranked as either moderate or low5:o- 
moderate, ^an<i only two were viewed as having. more than moderate conflict., 
Tnese judgment^ were in fairly close agreement t^lth the judgment of our 
interview respondents at the sites ,'^who also felt that co«lict in their 
prime sponsorships was gejjerally 1^. Given a three point sc^le (i « a s, 
lot^ 2 * some, 3 not muel^ , respondents, on the avferige, gave only two 
of their sites a score less thah 2.0. These were, incidentally, the eame 
sites that We judged to have more than modefrate conflict., " We will tise our ^ 
measure rather than average questionnaire response because our staff has had 
experience with other sites as a basis of comparlsoti, whereas our respon- 
dents lacked any such Basis. ^ 

It is clea;:, that service delivery decisd[,ops are generally related to 
conflict, but are there more specific aspects of primS sponsor characteris- 
tics or behavior that are related to conflict? Our i^taff Judged each ^ 
prime sponsorship on a number of different characteristico, many of them 
related in some way to service delivery. ^We useSt thes^ measures to test •a 
rtumber of specific hypotheses. The hypotheses dealt wli;h context, sta^f 
aggressiveneso, divergent values, and openness ofTthe decision-making 
process. We use'd" correlational analysis -^to test for relatic^iships,. In 
genaral, the^ correlations were very low and a number \iere Jjijthe" opposite 
tjirection from that expected* 

Context ^ • , 

We* felt that a number of different factors that form 'the context of 
the, relationship'between staff and service deliverers could increase the 
litelihoo^pf conflict. Two of thepe factors relate to the amount of Tit 
IciSnding received by the prime sponsorship. We hypothesized that 
conflict ik more likely when Title I funding is ^ecliniftg from year to 
year end when ^t he formula-determi«a .total is' flfmall relative to the size 
of the laboi: force.' In b6th cases, service deliverers would have to actept 
'less: in ^he first case, less than^the.year^bef^Qre;* in* the second case, , 
less! than seryice deliverers receiye in prime' sponsorships of similar size. 
A third factor thaVA cannot be'changei is the size of the minority 
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population (defined as the sum of the nonwhite and Spanish speaking 
populations. Converted ti percentages, as measXired ia the 1970 census) 
A larger minority population was hypothesized -to make conflict more likt."'./ 
» because it would increase the possibility of an ethnic struggle superlut- 
posed on the possibility of a purely organizational struggle for funds ^and 
staffing. A final factor that is beyond the control of the prime . 
sponsor is tYt amount/Of pre-?CETA experience accumi^^ed by stftvice 
deliverers. The greyer the proportion of agencies with such experience, 
we hypothesized, the more likely it is that they will be eet In their wayn 
and resist staff attempts tp change their behavior, thus generating 
conflict. 

Two final factors help form the context for conflict, and these are 
under th^ control of the prime sponsorship. If conflict is most likely , 
the result of prime sponsorVsejvice deliverer relationships,, then it peems 
reasonable to suppose that; conflict is more' likely when ther6 are more 
prime sponsor /service deliverer interactions. Tnes'e Interactions, in turn, 
are more likely when a greater proportion of a prime sponsor's Title I funds 
are used to fund outside agencies rather than to' operate programs internal- 
ly. They are also more likely when a prime sponsor funds progi^ams normally 
operated by outside agencies (work experience and clas^room training). 

— ^The context variables tended to produce only low to moderate 
correlations. Only one .was statistically significant!/ at even th6 .10 
level. The experience of service deliverers was not found to be positively 
related to conflict. In fact, the relationship was negative (a correlation 
of - .Ire). A review of the^ data indicates that this result was due iri part 
to^the distributions 'of values for the two variables: . confl'ict tended 
to be low in most prime sponsorships, while agency manpower experience was 
quite high. In such relationships a few cases can have ^ major impapt on 
the correlation, this seejns to h^e happened here. Give^ the circum- 
stancves, we hesitate to say that^ conflict is more likely where service 
deliverers are new. It is also |)lau8ible, of course, to hypothesize that 
experienc^pd deliverers V70uld create conflict .through reaistance to staff 
decisions if those decisions were thre^ening . It may be that in our siteo 
experienced deliver^ers h^d sufficient influence in the decision-making 
process to prevent decisions they did not ^^e« Thus there was no reason 
for conflict to emerge. 

Three of the j^raaining five relationships were also in th^^|j|.rection 
opposite that predicted, but they were ver^f weak relationships. Conflict* 
tended to be slightly more severe where Title I funding was increasing, 
where subcontracting was less extensive, and where a relatively small share 

^ " ' . 



At various ^points in the analysis we have used testa of statistical 
signiflcancci ,even though the 15 national sites do not constitute a sample. 
Social scientists are ^iv^ded over whether this is a proper use of the 
''significance test. For readings on both sides of this question, see , - 
Morrison and Henkel (1970). Given the debate, ve also report correlations 
that are not technically^ ''significant" but that are, at minimum, suggestive 
of important relationships. The general rule of thumb that "the higher 
the correlation, the more meaningful it is," should also be remeiii>ered ^ 
given both th'^ debate over the use of significance tests and the relatively 
small number of ccses with which tto ar^* nlealinc . 



of funds was devoted to clans room 'and vork experience propraaia. The 
(allure of the first' of these hypotheses seems to be due In large part 
to the exceptional behi^vlor of two prime ^sppnsorships: Duluth and 
Sacramento- Yolo . ^Duluth suffered the greatest funding ixit In our fifteen 
national sites (down to 73% of 1974 funding levels without adjusting for 
inflation) while Sa<;ramento-Yolo was among the more fortunate (124%) . Ao 
the site reprvts have indicated,' Duluth has enjoyed a remarkable degree of 
coinniunity-m4.ndec}ne8s In the manpower arena. All funded agen^cics. were 
willing to accept their shares of the cut. On the other haiid, the 
Sa<*ramento-Yolo consortium experienced the most conflict of the fifteen 
sites, Bilt this conflict was not typical. Service delivery quest ioro wc, 
involved; but so too were a large ntimber of other matters. It is not likely 
that funding\lfevels would have much Impact on that kind of problem. If 
these two sites were excluded,' the relatlonsrhip between conflict and 
furidlng cuts would probably be positive, as hypothesized. But even then, 
the relationship would not be a very strong "one. 

, / -The exte^nt of subcontracting and the size of programs normally operated 
by outside agencies were also^ negatively related (very weakly) to the 
'amount bf conflict, contrary to* our expectations. It would appear that 
so long as there are some service deliverers receiving some share of 
funds,' th,e context for conflict is obtained. The decree of conflict would 
'jtheh depend ,ph.,the,w^ in which the staff-deliverer relationship is 
^managed rather than on the number of such agencies (at least within 
reasonable linilts) or on the^size of their contracts. 

-The size of the minority population was not highly correlated with 
conflict, aUthoughit was in the expectfd direction. This lends credence 
to our earlier observat:^^ that conflict in our 15 sites generally 
involved the simple question: which agencies gethow^much money with how 
-much autonojEB(y? .The share of fteifvlces that eventually are allocated to 
various ejthnic oy minority groups in a community is publicly discussed only 
infrequenly. It also seems to b'e generally true that our national sites . ^ 
have given minority groups a r^asonablfe share of services. (See the 
section on prog^m participants, 'below'3^) 

• ^The amoune of funding relative to the size- of the labor forcfe did 
produce negatives correlation with conflict; as 'expected, but , the relation- 
^ ship is weak and so* we cl§lm little about it^ 

In short,, non^ of the contextual variables produced a significant , 
positive correlation with conflict.- This is probably no t^ surprising, given ' 
that even as hypathesized; the relationships are ii^irect; they set the 
stage for eonflJrc*, but; probably do not cause it. .Consequently, even 
though the cowrelatlons are generally low, it Is still possible that some 
of these variables are l»porta(Tt for the' understanding ^f conflict. X)nly 
a much larger data base would allow us to test the various indirect 
relationships in a*confldent way. Until such data are available, dlscuBsionc 
of the conterf for CETA^confMct must rem|in somewhat speculative and be 
based prlmarfiy% on first-hand observation. 

\ 
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Staff Aggressiveness . ; ^ 4 

The second group of hypotheses argues that art agjt^resslve staff will / 
have to deal with more conflict than ^ staff that take^ a laissez faire 
attitude toward its subcdntractors. Aggress iver^ss is^measured in 
e^ght jjifferent ways: extent of monitoring, quality of monitoring, extent 
of evaluation, quality of evaluation, the extent to which evaluation result; 
affect funding decisions, the extent to which the refunding of «etvice 
deliverers is treated as an dpen question, and the general quality and 
experience of the staff. These last two variables are included because 
the less able staffs spend so much of their time trying to keep up v/irh 
mere management routine that they have little energy left for InitiaLlvos 
directed. toward service deliverers. The less experienced staffs suffer 
from a similar problem. They too have had to spend more time on the purely 
mecbenical aspects of ^heir operations than staffs that were familiar with- 
manpower program operations prior to CETA. 

The only two significant relationships were found between quality of 
monitoring and conflict (-.48) and quality of evaluation and cojiflict (-.47). 
They were both in the opposite direction from thaTt hypothesized. (There 
were also moderate negative correlations with extent of both monitoring 
and evaluation.) These aspects of staff aggressiveness did not generate 
conflict, in fact, the regulatization of these relationships «eeni8 to havs 
reduced. conf lict . This is in line with the comments made in interviews by 
some service deliverers that they would like to be monitored and evaluated 
on the basis of explicitly stated criteria and program goals. They prefer 
this to capricious or arbitrary judgments about. how they were doing. 
Thus the reluctance of some prime sponsorships .to institute good monitoring' 
and especially good evaluation on the ba^is that they are too threatening, 
to service deliverers and would produce ^ unacceptably high level of 
conflict in the system is ill-founded. It might be claiming too much to 
say that starting ot^lmproving monitoring and/or evaluation willNcure 
conflict, but we can say with some confiaence that it is not likely to 
create new conflict. 

Divergent Valiies 

- The third group of hypotheses considers the respective values of % 
relevant afctors. Our observations, both in Ohio and in the natiou 1 sitos, 
Indiq^te tl^t a coimnon cause of conflict is a staff desire to improve per- 
formance in ways thdt run against a service deliverer desire to^cerye the 
most disadvantaged. This is particularly true when the service deliverer 
Ab a community action agency, since the CAA has a legal mandate and often 
an emotional commitment to serve the very poor. We hypothesized that prime 
sponsors that have staffs with strong placement orientations or prime 
sponsors whose service deliverers are particularly coinnitted to service 
to the disadvantaged ate most likely to experience conflict. 

The values we felt we dould measure did not serve to explain conflict 
very well. One relationship (staff commitment to placement) was negative 
and one (deliverer cotranitment to the disadvantaged) was positive, but both 
were so weak as to offer no support for generalizat^ions. . / 
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Openness of the Dectslon-llaklng Process |^ ^ • * 

We hypothesi^d that open declslon^mSiklng process would be related , 
tp less conflict than a lii^e closed proces^^. Specifically, we felt that 
where the l^C wg3 more acfive and influential there would^ be less conflict. 
We felt that those prime sponsorships In which the declfelon process was ' 
perceived to be open by the actots would have less conflict. Md we felt 
that 'in those cases In which service deliverers were perceived to have 
considerable influence there would b^ J.ess_ conflict because there would 
probably be less suspicion. * ^ • 

The ^V^elations in facr all turned out to be positive. One (with the 
MAC) was very low but the other two were reasonably high (.33 In the ^ase - 
of perceptions of openness and .49 in the case of service deliverer 
influence) • ^ 

~ ' ♦ 
In a general set\8e, then, opening the decision-making* system do'^s nQt 
reduce conflict. It may even Inerease it, at least for the short-run. 
What may be very Impytant, however, fs ^that the conflict' is likely to be 
^focused on such central questions as goals, target groups, an^J performance 
rather than on petty bickering, personalities, suspicion of fa^orjfeism for ^ 
spme deliverers, ethnic rivalries, and other concerns that are, frequent in 
pribe sponsorships with closed decision systems. The former cimfllcts 
are Important and legitimate points that need to be debated ln(open. The 
latter conflicts are petty and usually unproductive from the pi>int of view 
of improving quality of* programs and service delivery* To the extent that 
conflict is focused on important questions by opening ,the decision-making 
system and to the extent that that focus dispels petty and unimportant 
squabbles, we continue to believe that opening the system makes good 
""sense. It cannot be argued as a selling point that opening decision-makinjf 
will reduce conllicty in a41 cases but it certainly can be argued that it . 
will help focus disKreemant on important issues. 

^ . ♦ 

A Cluing Note 

,. # ■ , 

In our progress reports we repeatedly took the position,* based on our 
observations at the sites, that B staff that sought to avoid all conflict 
also usually avoided hard programmatic choices that ultimately would serve 
the participants better. We continue to take that position. Obviously, ' \^ ' 
we have not found what "causes" conflict or relative "absence of conflict 
in a stric^:'ly correlational sense. Perhaps our most significant finding is 
that one cfentral staff* activity often interpreted as aggressive — the 
instltutio^ or improvement of syatem^tit monitoring and evaluation of 
service deliverers — does not lead to increased conflict, but in fact it 
may lead to decreased conflict. But even those actions that may laad to 4 
increased jconflict — especially opening the decision process — can also have 
salutary effects if they help focus the debate and disagreement on important' 
issues the prime sponsorship should face rather than avoid. 

RELATIONS WITH BUSINESS AND ORGANIZE!) "LABOR ^ 

In this section we will bltiefly descrit^e the extent of business and 
organized labor involvement in CETA and then attempt to explain why it 
occurs in ^ome sites but not- in others. 

• ^ 46 
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By business Involvement we trcm the ej^^tent to which the prime sp^»f3or 
has been able to elicit the Interest and partlcipatlOia of businessmen .in 
the CETA program. This topic was a stantlard. part of each of our flf^^en 
site reports duxipg the pact year. Those discussions were used to develop 
a summary measure, raiflced from hfgh to low, for each of the national sites* 
On that basin, five of the sites were ranked medium l^lgh, one was ranked 
medium, three were ranked , medium low, and alx were ranked^ low in their 
ability to ellcif%islness involvement, ^ *^ 

It seems worthwhile to note-tha kinds of activities for which ?ltes 
were- given medium high rankings, both so lAe meaning of thq measure can be 
better understood and so readers of this report can profit fr©m the 
Innovations we observed. Dallas County, had a job fAlr that brought CETA 
clients and employers together. It also gave the local Chamb.er of Commerce 
a job development contract. Denver had organl^d conferences between Its ) 
staff and employers; it also subcontracted with a private ^#for-^prof It . 
corporation to drf assessment and placement. ^ Duluth's MAC surveyed c/^puoyer 
who had hired CETA part'icipants and used the responses to m^ke changes in 
the CETA, training program. Duluth also has Instituted an advisory board 
consisting of represelitatlves from business, labor, the CETA staff, and 
area vocational-technical schools to suggest ways in which the broader 
vocational education estaWLlshment can serve the needs of Industry In the 
area. Wilmington has 4^6loped new courses in such high paying skills as 
plpef Ittlng and shlpflttlng In close consultation with a local shipbulld^ir, 
which has In turn hired most of ^he graduates of the course. 

^ . IlL general; those prime sp««sors that subcontracted all programs were 
.less Successful In eliciting business cooperation than those that^ retained 
some or all programs in^house. 

Success In Involving business Is related to the proportion, of 
businessmen on the MAC. The correlation is reasonably high and would be 
substantial except that one prime sponsor with a low degree of business 
involvement had a large number of businessmen appointed to a council t^t 
never met. The only other major exception was a prime sponsor that 
delegated responsibility for developing business ties to. service deliverers 
Business Involvement seems to be enhanced iriien a prime sponsor has a large 
proportion (roughly 13% or more) of businessmen on an active and'' 
, Influential council and when the staff makes liaison with business a major 
priority. Appointing a major local employer to the chairmanship of the 
council will often produce some desired results It Is clear from ot^r 
experience both In Ohio and In the national sites that close cooperation 
between local employers and the CETA program does not come easily. 
Employers generally want to hire the most qualified applicants available; 
they are unlikely to believe that such applicants A/lll be found on the 
CETA rolls. Only close cooperation Is likely to change that impression. 

There Is less to say concerning labor Involvement -simply because there 
Is BO little. There were labor representatives on almost all of the ' 
councils. Often labor was heavily represented on these councils. But 
frequently labor's interest was quite narrow, focusing on the Impact of 
CETA programs on the promotion opportunities or other such concerns of • 
municipal and county employees. In other cases t labor representatives on 
the councils simply acted as Individuals concerned with the success of a 
government program, not as representatives of a larger organization with 
specific interests* ^ ^ 



Lowoll and King-.lnohoniBh are major exceptions, yh^sy both 8ponsor€.d 
apprenticeship programs for CETA ptfirticipants. This emphasis on trainipg 
in the skilled trcdt-a clearly the most valuable direction for CETA/union 
cooperation to take, because only unjon participation will give CETA 
participants a chance to enter these occupations. 

A fw rt*^er prime 'sponsorships C^otably Dallas County and the 
Blnnlngliam Consortium) have taken smaller steps to use unions to gejC 
participants into the skilled ttades. 
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III. rnoGivrt r/'^TicXPA:"s 



DESCRIPTION OF TITLE I PARTICIPANTS 

V 

Tablo ? shows the characteristics of Title I ^participants enrolled aiAl 



entering employment for the nation, the state of Ohio, and the 15 national 
sites for three selected quarters. The percent of finy group enrolled Is 
calculated by dividing the nutrber of that group enrolled, by ths iivmber of 
all Individuals enrolled. The percent of arty group entering employraiat Is 
calculated by dividing the number of that group entering employment by the 
number of all Individuals entering employment. As the table shows, the 
two percentages can vary considerably • That Is, the characteristics 
of those^served through enrollment In CETA and those^who enter employment 
from a CETA slot ^e different.^ 

The three quarters used In table 1^ were chosen for specific reasons. 
•Deceirfjer, 1974, Is tffe earliest date for which complete data sgre available, 
and thus gives an early reading, , based on -cumulative data for two quarters* 
June, 1975, Is used because the data are cumulative for the first full 
year of CETA. September, 1976, Is used because the data are cumulative 
for the five Quarters beginning In July, 1975. Data were also available for 
D€cen±)er, 1976, but were not used because they repiresented only the first 
quarter of Fiscal 1977, * ^ ^ • ' 

, Primary attention in analtyzing the data presented in this section will 
be devoted to discussing the participant service patterns and changes in 
the 15 selected prime sponsors, and relatingttrese to national trends. 
The Ohio figures have been added for comparative purposes and the discussici 
of Ohio results will be limited to noting the relationship between patterno 
uncovered In the selected sites and those found in Ohio, except in those 
casq|B in which Ohio patterns diverge noticeably from the national 
patterns or those found in the 15 selected sites. 

Patterns of ^enrollments revealed by Table 13 are as follows: 

l/" Nationally, in Ohio, and in the 15 sites, participants' are 
beconang less young. 

2. In all 3 groups, participants* are becoming better educated. 

3, Nationally, the percentage of nonwh^te participants has remained 
virtually unchanged. In Ohio, the percentage has declined somewhat. In 

the national sites it has increased somewhat. 

> _^ * 

■ 4, In all 3 prime sponsor groupings. Title I participants have become 
less disadvantaged. However, economically disadvantaged participants, still 
accaunt for at least 3/4 of all participants in all three groups. 

5. The percentage of females in all three groups has stabilized 
after an initial moderate decline. 
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Table 12; CHARACTErJ^TICS OF TlTiE I PARTICIPANTS EliROLLED AlH) ENTERING EJffLOYMENT. 

U.S., OHIO, AfJD NATIONAL SITES, SELECTED QUARTERS, 1974-1976^ 

\ 

(percentage enrolled are the numbers not In parentheses; 
percentage entering emp-loyment are the numbers in parentheses) 



r 

Characteristic 


U^S. 


% of All 
Participants 


i. 

-Ohi 


I of All 
o Participants 


% of 
15 


Particips 
National^ 


nts at 
Sites 




12/31/74 


-6/30/75 


9/30/76 


1^/31/74 


6/30/74 








9/30/76 - 


FcmaJ-e 


49 
J43) 


45 

(43). 


46 

(43) 


47 

(41) , 

I 


44 

(43) 


■ 43 
(40) 


47 

(42) 


45 
(41) 


46 

(43) 


Non-wh%e 


(43) 


44 
<40) 


(36) 


58 \ 
* (29) 


55 

(57) ^ 


52 
(47) 


37 

(28) 


39 
(32) 


42 
(33) 


Under 22 
Years of Age 


65 
(45) 


62 
(41) 


57 
(38) 


68 
(45) 


61 
(36) 


55 

(33) 


■ 64 
(54) 


63^ 
(39) 


> 52 
(39) 


With 12 Years 
or More Formal 
Iducaticn 


34 
(53) 


39 

(57). 


46 

(63) 


34 
(54) 


0 

38 

(62) 


47 

(62) 


36 
(51) 


38 
(58) 


' '51 
(65) - 


Economically , 
Disadvj.nt. ^ed 


81 
(73) 


• 78 
(76) 


78. 
(68> 


84 
(74) 


82 

(76) - 


76 

(63) 


81 
(81) 


• 78 
(76) 


75 
_ (65) 
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' Wlien the focus changed from service Tr.?a3ured by cutollments to 
service measured by thor:e entering employment, the data chow that the 
percentage of feoinl'^.L?/ non^whites, economically disadvantaged, and those 
under 22. has generally been below the percentage of each group enrolled. 
This pattern holds for all three groupings of prime sponsorships and across 
.time periods. The percentage of thoJfe entering employment* with more than ' 
12 years of formal education, on the pther hand, has been consistently 
higher than the percentage enrolled. 

Changes In the 'percentages^ of each group entering employment usually 
conform to changes In the level of enrollment of each group. ^ Tlius, for 
example, decreases nationally in the level of enrollment of persona undo.r 
22 were accompanied by decreases in the percentage o*f this groups 
entering employment. 

Table lA analyzes entered employment patterns for the 15 national sltf , 
on an individual basis. The table is designed to ^mderscore differences 
between the enrollment of a group ^d the entered employment status of a 
group. A cell Is marked if that difference is 5% or more. 

J . 

The most striking patterns revealed by^Table 14^ involve education and 
age. There is more than 5Z difference between enrollment figures and ' ' 
entered employment figures for almost every prime sponsorship and, with 
only one exception, the entered employment rates are considerably higher 
than the enrollment rates for those who have more education and are older. 
This is in large part attributable to youth work experience- programs that 
'do not have placement as a goal. There were similar cases of substantially 
lower entered employment rates for noji-i>hites (six cases) , economically 
disadvantaged (four cases), and females (three cases). These were offset by 
only one case for economically disadvantaged and one case for females In 
which the entered employment rate was 5% or more higher than the enrollment 
rate . 

We also Inspected the samfe data for the 17 Ohio prtms sponsorships. 
Similar patterns vrere present in the case of education and age. In 
thirteen of the Ohio prime sponsorships the entered employroent rate exceeded 
Ae enrollment rate for those with at least a high school education by 
5% or more. None reported a difference in the other direction. In fourteen, 
again with no contrary cases, the entered employment \rate was less^ than 
the enrollment rate by 5% or more for those under 22.' There were, however, 
more consistent patterns of difference in Ohio than in the national sites 
in the case of both economic status etnd gender. Ten Ohio primes reported 
the entered employmljtt rate as less than the enrollment rate by 5% or 
more for economically disadvantaged participants, with only one contrary 
case. Six. Ohio tx|;imes reported the same pattern for females, with two 
contrary cases^^^ix Ohio primes reported this pattern for nonwhit^s, with 
three contraty cases. 

\^ 

DESCRIPTION OF TITLES II VI PARTICIPANTS ^ 
Title II . 



Table 15 shows participant <«racter%lstics for all individuals enrolled 
in ^1 tie II for the three groupings of prime sponsorships. In this table ^ 
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Tablo 14: AK/iYSIS OF FNTEF^D EMPLtYIIEIIT P.'.TTE.^o C y:J^ZD I" ill^.-- ivTTERNS, 

NATIONAL SITES, SEPTEi'^ffiER, 1976^ Tl'LLW'l 





r: liAtaxcd Emplcymeat Exceeds % Enrolled 
, by 5% or More 


% Entered Employmeot is 
by 5% or 


Less 
More 


Than % 


Enrolled 


ppuus sn xp 


Female 


Ton-vhite 


Under 22 


High School 
or More 


Economically 
Disadvantaged 


Female 


Non -white 


Under 12 


High 
or 


School, 
More 


Econonicaliy 
Disadvantaged 


Connecticut 






* 


X 










« 


% 


Lcuell ^ 










•. 






X 


-* 




Cvnberland, NJ 








r 

X 






1 * . _ 








Yonkers 




-a 




X 






i 


X 


X 






t^ilmingtcn 








X 


f 


X 




X 


X 


- A 
P 


1 


Lur.erne 








- 










X 






BirnLlngham 








X 




7 — 

X 




1 


X 




' X 


Cusiberland, NC 


X 










t 


I 

X 


X 




X 




— ^ 






X , 


i< 






X 






Arkansas 


• 






X 






X' 


X 






Dallas 














X 


X 


j 














X 


J 






X 




Y 
A 


Denver 










i — ' 






X 


■ 




Sacranianto-Yolo 








X 3* 






i 


* X 


/ ; 




!Iing-Sn ohomlsh 










M 


X 


-\ 


7 

X f 
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IJjle 15: CH/U^iCIERtSTICS 0? TITLE II PARTICIPAI^TS ENROLLED, U.S. /OHIO, 
- x\^:i)aJATIONAL SIT-ES, SELECTED QUARTERS, 197A-1976 



4 C'^rracteristlc 



Fe'iale * 
. ::cn^ White A 

'12-44 Yo^rs Old 

u'lth 12 or More" 
^'ears Formal 
iL^ucation 



E2.:iC!nically 
Di^advdntagcd 



^ ♦ % All 

' * 0;S> Participants 
,12/J4 6/75 6/76 12/76 

**35. 33 36 



% of All 



% of Par-iciRants 
at 15 flational Sites 



31 



32 



39 



74 



46 



75 



45 



64 



39 
33 
64 
75 

■ 45' 



12/74 


6/75 ■ 


-6/76 


12/76 


• 12/74 


6/V5 


6/76 


12/76 


















27 


33 


30 • 


36 


31 


39 


^40 


39 

ft 


-47 


42 


37 


24 




28 


25 












» - 








\ 64 


62 


66 


65 


■ 65 


68^ 


68 


.67 










m 






72 


75 


78 , 


76 . 


" 78 


81 


^ ■ 
















48 


■ 36 


■43 


38 


32 


43 


. 49' 





32/74 rr^ifres jlo not include Dallas -Coumty, which' had no program, BOS Conn. wH&re no dafi^.^ere available, 
and Wilmington Del., which had no ^rollees that quarter. / ^ . - 

'0/75 figure's alyo^^o not inillude Dallas County.. ' • y ^ . 

6/76 figu^^s excliraa^B^llas County , -which had no program, a».d .Binninghs^, Alabama for which no data 
were avail^le, , , % \ • ^ 

li/ 70 figures include all 15 sites.'. . . - * . - 
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we have used figures for June and December, 1976, instead of those rep:»rtcd 
, In ^eptenber, 1976, ill ord^r -to determine the impact of the movement or 
participantq bctx/een Titles II and VI, which began late in TY 76, The 
June figures represent the composition of participants Just prior to a 
large scale shifting betweehvTitlW^ The December figures teprSsen*' the 
composition after most of the movement had taken place« 

For the nation as a whole, during the , period from December, 19^, to 
.June, 1976, there ±9 substantial Increase in service to nonwhites. Levels 
•for the other groups remained fairly stable during this period, alt-hough 
there were some very slight intire^ses ^in service to women, 22-44 y^^^' olds, 
and economise ally disadvantaged participants T Aft-er June of 1976 there are 
several significant changes in the national Title II service patterns. 
Firsts there is a Significant increase in the percentage of wometi served. 
There i^ also a decline in the level of service to the economically . - 
disadvantaged. T^e average-age and educa^tional background of Title II 
participants remained aboo( constant.' ^ 

Overall, client service patterns for the 15 selected pyime sponsors 
show a great deal of stability. The one noticeable change occurred between 
December, 1974 and June, 1975. By the end of FY 1975 there were significant 
increases in the rates of_service in all five categories of participant 
characteristics being analyzed, in comparison to the December, 1974 levels. 
Prom that point on there is very little change 'in the aggregate service 
levels for Title II participants in the l^selected sites. The changes 
evident for the nation and for the state Jfc Ohio in Title II service rates 
after June, 1976, do not appear in the ^g^egate figures for the 15 ^ 
^fleeted prime sponsors, except, for a, decline in service to the economically 
disadvantaged* * - . ^ 

« 

The changes in Title II participant characj:eristics that appear after ^ 
June, 19/6, are primarily because of changes in CETA policy. In the spring 
of 1976 many prime sponsors were running out of Title VI money, and the 
Title VI extension was bogged down in Congress* In March-, emergency 
supplemental funds were received under Title II. Subsequently alli 
restrictions, on moving PSE participants between Titles were •removed. 
During the , late spring and continuing tl^rough the sumner of . 1976, iii:ime 
sponsors moved many, and in ^ome cases, all, of their Title VI 'participants 
'lnto**Tltle/Il/ Thus, the December, 1976 figures reflec?t the Impact of 
^ this movement of peog^le out of title VI and into tit le II. 

" Title VI . . ' . ' , ' ^ 

• Table 16 sjiows participant characteristics for all/ individuals 
enrolled in Title VI for the three* groupings^ of prime sponsorships. The^ 
national pattern was for service to women and nonwhites* to increase ^^'^ 
between June, 1^75t, and June, 1976, with service levels in the o'ther 
categories remaining essentially the same* By December of 1976, with* many 
f^wer participants enroll^ed. Title VI service rates fat; norfc^hites declined 
while service to the economically disadvantaged increased. This change ' 
was particuliarly dramatic in th^ case of the economically disadvantaged. 
In June, 1976, the rate of service to this group was three percent higher . 
in Title II than in Title VI. Bjr December, ^1976, the relationship Was re- 
versed, with the '^^rcentage of econdmlcd'lly'disadvantaged participants in ^ 
Title VI being 5 percent higher than in Title II. 
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Table 16: CHAPACTERISTICS OF TITLE VI PARTICIPAMTS ENROLLED, U.slj^HIO 
AND NATIONAL SITES, SELECTED QUARTERS, 1975-1976 ' ' , 
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,^ 8 of Crio's 17 Prime ' Sponsors no longer had Title VI programs by 12/76. 



6 of th" 15 sites no Idnger h#d Title VI program-V by 12/76i 
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There are.tw^) j^osslblei explanations for this pattern. The first la 
that prime sponsors did not -transfer Title VI participants to Title II - 
in a random fashl jn . Thus, a higher percentage of nonwhlUe and economfa-illy 
disadvantaged participants were probably transferred than riemalned on 
Title VI. This choice v;as probatly Influenced by*the riey Title VI eligibi- 
lity requlrementB, which imposed stricter income qualifications on Tit-le VI 
p.artlclpr.ntr:. Taking note of this change, many prime sponsors may have ^ 
decided to reduce future problems by leaving a high percentage of economi- 
cally dlsadj^antagcd participants oh Title VI. The second possible explr.na- 
tiqn takes Into account the fact that some prime sponsors were no longer 
operating Title VI {urograms by December, 1976. If these prime sponi-ovo 
were systematlcally^lf ferent . In the types of clients they s^Qrved 1ft - 
comparison to these s*tlll operating programs, this could account for. the 
pattern of change described abov§. 

The patterns of Title VI service for the 15 selected prime sponsor*? 
were slightly different than those, f or^ the nation and Ohio. There vas an 
Increase of enrollment of women, nonwhltes and those with 12 or mor^ yearr? 
of education between June, 1975, and June, 1976. There was only one * 
significant change In enrollment between June and December of 1976. There 
was a substantial decrease In the rate of service to nonwhltes.* As noted 
above, many prime sponsors no^ longer had Title VI programs by December > 
1976. This aggregate ^decrease In service seems to be explained by the fact 
that the sites not reporting Title VI activity In^cember Included many 
containing klgh concentrations of non-white participants. Thus, the aggre- 
gate figures, based cm a reduced number of sites, showed a decrease In 
service tp- nonwhltes . . * - ^ 

Titles II and VI -^Considered Together / k 

As the above discussion Implies, It Is difficult to sort out the^ 
differences between reA changes In Title II and VI service -p;^ttems , and 
apparent changes caused by changes in reporting practices, or movement 
between the two titles. Furthermore, many ^^ouid* argue th^t the two programs 
were essentially the same, especially since the elimination of restrictions 
on movement between the titles, and one, should devote attention to the 
overall PSE client service patterns, rather than looking at the two 
Titles separately. ' I 

•» 

In Table 17, dat^ on participant service, -botb entollmetXI^ and entered*' 
employment, for Titles II and VI Have been combiaed. These figures would 
seem to be the most reliable fot identifying real changes Iri PSE pa^rticipant 
since they include' cumulative totals for the four- quartets ehding in 
June, 1975, and the five quarters ending in September i 76, which ta|ces 
into account the summer of 1976 when muc^^ of the^ switthln^etween Titles , 
was taking place. On the basis of^the data shown in Tabl^ 17, the 
following general statements about PSE participaitts sejsm warrari;tedi 

1. Nationally, PSE enrollments included an increasing percentag?*- of 
women and nonwhltes. . ^ 

2. ' The age, educational background*, and income status of PSE enrolleea 
in the nation has remained stable. - . 



'^^ablo 17: ^ a^ARACTLRlSTICS 0? TITLES II AKD VI PARTICIPAITTS COMBINED, ENRCLLTO 
_ ' r ^tjt'D E>rrERi:\C EMPL0Y>ENT^ U.S., OlilCr, and national sites, FY 75 and FY 7* . 

5 ' ' ipeic ./.tags enrolled are thr n>jmbers •nOt in parentheses; percentage enterl/g employment 

are the j;iumbei^s in parentheses) / 
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3. Ohio diverged frov* the !>ational pr.ttern In r-:'.iib j ting a patte *n of 
Sdecrer.slng enrolliji^nts of nonwhitosr and the economically disadvantaged'; 
Ohio also lncrea^c»($ enrollments of 22^44 year olds and of those with 12 
more years of ecfucaclon. 

A. The /is selected prime sponsors also diverged frpm the national 
trend by d^ryf'Baslng enrollment of nonwhites. ' 

{ - , • - 

5. Ii\ contrast to Ohio, enrollment of women In the 15*selected prlne 
sponsors increased slightly, which conformed to the national trend. Also, 
the Ohio pattern of Increasing enrollment of ll^kk year c)Ids and tho.'e xritli 
12 or more years of formal education was reversed for the 15 selected 
sites, although the absolute level of service to" these groups was compara- 
ble. . > * 

The PSE entered employment patterns showij in Table 17 are very similar 
to those for Title I shown in Table 13. Females, nonwhites, and th^ 
economically disadvantaged enter employment at a lower rate than they are 
served. The opposite is true for ^2-44 year olds, and those v^ith .12 or more 
years of formal education. This pattern holds for all three sets of 
prime sponsors. In general, there was very little change in these 
relationships over time, except for, an. increasing percentage of females 
to enter employment in FY 76. r* 

In Table 18 the relationship between PSE participants enrollment 
rates and entered employment rates are Broken out for each of the 15 
selected prlitfe sponsors. As was the case with Title I (see Table lii» 
the most widely shared patterns are those concerning age and educational 
backgroui^. However, it should be noted that the ni-'mber of prime sponsors 
conforming to these and the other trends described above is significantly* 
lower for PSE than for Title I. It is also tru^ that the selected sites 
were tiuch less likely than the Ohio sites to follow the national pattern 
of different levels of service in client categories for those entering 
employment compared to all clients enrolled. 



EXPLAINING PAR TICIPANT SERVICE PATTERNS 

This section attempts to account for variation^ in participant a^^rvice 
patterns among' the 15 selected prime sponsors, the differences between ^ 
Title I aad PSE^ptograms, .and the changes in characteristics over time. ^ 
The primary thrust of the analysis is on the level of service and changes 
in the level of service to females, econOTiically disadvantaged, and 
nonwhite grbups. The attention accorded females coincides with the 
growth of interest in research on the labor force participation of Women. 
The latter two groups are given emphasis as it was argued that they would 
suffer most in loss of* services from a decentralized and decategorized 
program^ such as CETA (see Hangum and Spedeker, 1974:309). 

The following sets of factors will be utilized to contribute to. an 
understandinjg of client service patterns: 1) local economic conditions and 
demographic characteristics;* 2) local programmatic decisions; 3) relevant 
attitudes of influential local manpower actors; 4) Manpower Advisory 
Council influence and activity; 5) specific management decisions; and _ 
6) the impact of national pblicy and regional office activities. 
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Table 13: A:u-.LYSIS OF ENTER£2 E-TLOYMENT PATIERIIS COllPARED TO ENROLLMENT PATTERNS, NATIONAL SITES 

SEPTEMBER, 1976, TITLES- II AND Vl\COMBINED 
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Local 'Economic Conditions c^^d Denciraphtc Characteri-3tics ^ 

Economic ccrdlujoTs rnd demographic characteristics may directly' 
affect the pool of povOntlal CETA applicants. Ihe following section 
presents the results of a variety of analyses designed to assess the 
relationship between economic conditions and client service patterns.. 

1970 Census Data > Jnitlally, service patterns as of September, 1976, 
were compared with 1970 Census data. It is recognized that census figures 
are dated, but they provide a starting polftt* The 197Cr percent unemployed 
who were mon-whlte, female, and those living in families below the poverty 
level were considered, ^ht poverty figure was used as a surrogate measure 
of the number of economically disadvantaged . * For Title I, six of the 15 
prime sponsors served a smalj^r percentage of females than the percent 
unemployed who were female. One prime sponsor served a smaller' percentage 
of non^whltes than the percent of nonwhltes unemployed. All 15 served 
a higher percentage oT economically disadvantaged than the percentage, of 
persons in families below the poverty level in their area. 

For PSE (Tftles II and VI combined), 11 of the 15 sites served a lower 
percentage of women than was represented in the unemployed census figures. 
Three prime sponsors served a lower percentage of nonwhltes than the 
percentage-unemployed who were nonwhlte. One site^ served a lower percentage 
of economically disadvantaged than the percentage of persons living in. 
families below the poverty level. 

^ Careful inspection of the relationship between participant service 
data and census data leads to the conclusion that service levels are not 
determined by variations in the cpmpodition of the unemployed population* 
Prime sponsors with quite similar demographic make-ups vary* considerably 
in service levels to the same groups. Basic demographic composition may 
serve as an outer limit on variation in participant composition, but it ^ 
does not determine it. 

Employment^ Service Active Files ^ ^'A more current measure- of a prime 
spons'or's "universe of need" is provided by data derived from the active - ^ 
files of local Employjnent .Services offices. (These data are derived from 
the Employment Service Automated Reporting System (ESARS) .) These files 
Include CETA ellglbles such as the unemployed, underemployed, and economi- 
cally disadvantaged. The active files also include a number of individuals 
who are currently employed and* are seeking hew employment* • It is ^difficult 
to assess the size of this group, but the best estimate^ is probably 10% 
or less. To tl||!f4|xt«nt that the non-dlsadvantaged outnumber the disadvan- 
taged in this gifeup, an ov^statement of the incldente of need rea^ilts. 

There^are factors, however, that could serve to understate the 
Incidence of need.- Some wo^^ers ("discouraged workers") may give up ttfeii: 
search for employment ^during recessionary periods. In addition it has 
been suggested that certain minorities may be reluctant to register With 
ES (see Camil Associates, 1975). 

Finally,, the matching of prime sponsorships and ES area offices is an 
approximation. The ^ata are by plac;jB of residence. In addition, individual 
may register ^t mote than one ES office. Despite these limitations, the ES 



data represent an accossibla and current surrogate measure of need within 
a prime sponsor chip. 

Table 19 SLmmarj..:*^^ the relationship (in-the^form of a simple corre- 
lation) between the unemployment rate and 1) ESARS data on percent econo- 
mically disadvantaged, 'pet^<;^ent female, and percent white, and 2) enrollment 
rates for tl^*"- same deftiographlt^^oups. The analysis reported was for 
September, X976. The same analysis was carried out for all other quarters 
with similar results. The correlations ^etween the unemployment ;rate 
and the ESARS data are for nine sites. The correlations with enrollment 
rates are for all 15 sites. ^ 

The inverse relationship obtained between, the unemployment rate and 
the percent economically' disadvantaged in the ESARS pppulation can perhaps 
be explained by the fact that those who are losing their jobs are not 
ecotiomlcally disadvantaged. The positive relationship between percent 
economically disadvantaged in PSE program^ and the unemployment rat'* shov;^ 
that prime sponsors with high ratles of un^proyment tended to serve a high 
p'ercentage of- econon^lcallyldlsadvantaged in their Title N and VI programs. 
This suggests that .Sustained periods of high unemployment may make it easier 
for prime sponsors to. find qualified PSE participants who are economically 
disadvantaged/ even though the percentage of persons on the universe of 
need who are economically disadvantaged does not necessarily increase. 
Virtually no relationship was found between the unemployment rate and 
Title I economically disadvantaged clients. ' \ ^ 

The inverse relationship between the unemployment^ rate and ESARS for 
females Is also evident ifi the Title VI program; no relationship exists 
for Titles I and II. The implication of these correlation^ is that 
relatively more men than women are losing their jobs. The Title VI Service 
.might be Said to reflect this pattern and as a result serve fewer females 
when the unemployment rate is high. * 

The correlations between the unemployment rate and percent white in 
. the 'ESARS population is quite low. TheVe is, however, a relatively strong* 
negative relatlonslilp between the unemployment rate and whites in Title I. 
^ positive relationship is in evidence in the PSE titles. This result is 
in line vith the fact that nonyfiites are more represented in Title I than 
in either Title II or VI . , ^ ^ ^ 

' . • ' ^ 

Table 2fi presents an index of the Relationship between enrollments in 
Title I and unive?tse of need estimates for the 15 national sites. ES data 
were available for^ll of the 15 sites, and census data have been supplied 
in the other four cases. The most severe probletn this latter substitution 
j^mposes concerns the category of edonoraically disadvantaged. Tlje census^ 
measure of families below the poverty level is not comparable to the ES 
figures for tl\e economically disadvantaged. Thus, the ratios between 
participant enrollment levels and universe of^ need estimates for the 
Economically disadvantaged in the sites for which census data have been 
siipplicd should notrbe compared to the other 8ite8,"^but can 6e compared 
to each other. ' ^ 

Table 20*shows that by September, 1976, only five of the national 
sites were serving a lower percentage of w^men under Title I than was 
present In ^helij universe of jneed estimates. Title I service to nonwhites ' 

^ ■ - 

6; 



.J 



Jable 19: RELAWOMSHIP BETWEEN UNEMPLOYMTdn' RME AND SELEC^l 
, DSMOGRAPKIC CHAM^ERlSTfCS, NATIONAL SITES, 5EPTEMBJ?R, \97( 
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Statistically significant at the .fb level. See the fobtnote on page 32-on our use of significance tests. ^ 
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Table 20: R/.TIO OF 'TITLE I PARTICIPANTS EHROLLED TO ESARS 
POPULATION FOR SELECTED DE110GRAPHIC GROUl'S, NATIONAL , 
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''ESARS data were not available^ 'I97Q census data were substit^uted. 
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wae beldw the uni^^ero(^ of'r/eed est 'mate for fionv/hltec in ctiiy one site. 
All 15 sitea netvcd a highor, percentage of economically disadvantaged 
.persons on Titlo I't.h^n present in^hoir universe of nbed^ estimates ..^ 

' In Ohio cc'-'pHLTible £S, and census datp were available for ,15 prime' 
spoosqrshlgs. The relatienships between categories of Title i participants 
ahd their, 'vr r^sentation in universe of need estimates were very similar 
to those in the 15 national sites. Four of tHft 15 Ohio sites served a 
lower perceiftage o{ women^thair was present io their universe of need; All 
15 served a higher percentage- of nonwhites. All except one served a higher * 
percentage <}f ecotiomically disadvantased than the' percentage pf thct:.'^. 
groups in.the universe of need estimates. 

w » , ' \ " " 

It*is'a^o important •to take note of dhanges in th^ relationship 
between client^ ^ervice and the estimated universe of need over time, * 
because this provides some idea of the responsiveness of local prime 
sponsors to chartges-ln the toake-up of the eligibly participants' in their 
area. Cbanges may Indicate attempts on the part o^ prime sp^isors to 
redress, what they consider tcf be imbalances id their service record with 
regar,d to certain groups. C 

Two pride sponsors moved from serving a loweTif^erce^tage of women in 
Title I than was present, in their universe of need estli&ates in June, 1975, 
to serving a higher percentage of women than was incluued in the estimates 
for September, '1576- However, two other sltes/already .serving a Lower 
per^entkge of woi&en in FY 75 then was present in their universe of need * 
estimates significantly de6reased that service in FY 76^ -Among those sitesV 
serving^ percentage of women that matched or exceeded the universe* of 
need estimates, during both time periods shown, six decreased their level of 
service to wonien by September, 1976, while 2 increased iV. . ' , . 

Of the 14 sites serving* a higher percentage of nonwhites than was 
present in their universe of" need estimates, 9. moved in the direttion of ^ 
' reducing this difference, while 6 moved In the opposite direction. The ^ 
only„site to serve a Jtower*^ percentage of nonwhites than was included in , \ 
the estimated universe of need exhibited llttl^ change J.n the ratio 
between these tiK) populations. 

OnJy two primes showed an Increase in the ra^tlo of percent economically 
disadvantaged served to the percent of economically disadvantaged in 
their universe of need estimate 'between June, .1975 and September,- 19J6. 
In 12 other sites the ratio deqllned, and in one site it remained the same. , 

. Table ^21 shows the relationship between client? served in Titles II 
and VI combined and an estimate of the pqol of CETA ellglbles dcrived^from 
^ ES active files and* 1970 Census, figures for selected characteristics in each 
of .the 15 prime sponsors s<:udied. The pattern established in Title 148 
repeated for PSE In most respects*. By September, 1976, almost all of tlie 
15 selected" prime* spcKiaors served a high^if percentage of non-whites and 
e^homlcally disadvantaged' participants than these groups represented la 
the estimated universe of need. There were four exceptions witlf regard 
to nonwhites and th^ee exceptions for the economically disadvantaged. PSE 
service to females was mixed. Nine of the 15 sites senred a lower 



Table 21: RATIO OF COlffi-IJlED TITS-ES II AND VI PARTICIPANTS ENROLLED TO-ESTIMATED 
CETA-'ELlGIBLi; rOillATIQN FOR SELECTED DEMOGRAPHIC GROUPS, 
. . ■ MTIOfTAL SITE?, JUKE, 1975 A^:D SEPTEMBER,' 1976 ' 
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ESARS data were not available; 1970 census Siata were substiltlted. 
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. percentage' of females thlaft were represented In the eilslble population, 
while th^ remaining 6 sites served females In roughly the same proportion 
as their representation in the eligible population. None of the 15 - 
prime; sponsors' eerved a significantly higher percentage of females than 
was^present In tae .'£3 active file. * , ^ 
1^ " 

Varlatioo^ imong the 15 Ohio prime sponsorships f oi; w^ich data were • 
available in setvice to f einales and 'nonwhites was ^igaln, very similar to • 
jAat* present among the 15 selected prime-sponsors. Nine of the 15 Ohio. ^ 
sites served a lower percentage of women In PS^ than was present In the ' ^ 
estimate of their eligible populations. Two of the 15 Ohio sites followed ' 
this pattern for noftwhites / There was, however', a very significant 
difference In PSE service .to the economically disadvantaged. ^ Among. the 
Ohio^sites, 10' of 15 served a lower percentage of economically disadvantaged 
than was present in the ES and Census estimates of the eligible populations, 
compared to only two^of the 15 national sites. ' ' - 

In June, 1975, 11 of the 15 na£tonal sit^ were* serving a lower 
percentage of women in PSE than was present In their universe of need 
est'imates.' By September, 1976, six of these sites had move^ In the 
direction of narrowing this gap.; In two cases the resulting service ^level 
matched or exceeded the percentage^ of wcmen present In their estimated 
universe of , need. Four of the five remaining prUne sponsors whuse level of 
PSE service was below that of their universe of need estimates moved in 
the direction of widening the gap. In' one case the ratio did not chartge. 

All three of the prime sponsors serving a lower percentage of nonwhltes 
then was present in their universe oLneed estimate In Ji^ne, 1975, showed 
an increase in service to this 'group^ One that served a signif icar^tly ^ 
higher^ percentage^ of nonwhltef thao was included in the estimates for 
June, 1975, decreased service to this group to the point that it was 
serving a Im/er f)ercentage than contained In the universe of need estliaate 
in September, 1976. Of the 11 sites serving the same, or a higher- ^ 
percentage of nonwhltes in PSE than represented in the unlvers* of needs 
.•estimates, eight moved in the direction of narrowing this gap, two Increased 
the gap, and one remained the same. ' . * ^ 

For the economicallir disadvantaged, two sites in 'which the PSE service ^ 
level was belo\f the universe of need estimate moved to widen this gap. -One 
moved from a position of serving a substantially higher percentage of 
economically disadvantaged tKan was present in its estimated universe ol / 
need in June, 1975, to sending a lower percentage of this group .than was 
present in this, estimate My Septenfcer, 1976 . Among those serving a 
higher percentage of econdtaically disadvantaged in PSE. than was p;resent In 
ytheir estimated^nivers^ of need for both time periods, seven moved in, 
the direction of narrowing the gap^ while five moved in the opposite . 
direction. ' f * * ,* 

The analysis above focuses exclusively on, the relationship between ^ 
•combined Title II and VI participant service patterns an^ universe of need , 
estimates*. It seems appropriate at tlyis point to identify any systematic 
diff erenc;,es.)ln the level of service between the two Titles. While most ^ _ 
of the 15 sites displayed soiUb noticeable differences between service ^ 
levels In the two PSE Titles on the three characteristics, thejre Werp no 



systctnatKPpatterns of thcr.e differences in most casscr. • The cxcfi>t>tlotiD 
were Central Iowa and Blri^ingham, in which: the Title VI programs included 
much lower percentages of females, nonwhltes, and economically disadvantaged 
than the Title II I'jc.'^ranis , tind Luzewie, in which there were many more 
women and econonicilly disadvantaged persons in the Title VI program than 
the. Title II program. Overall, there was a mild tendency for differences 
that occurred tO'be in the form of lower rates of -service to women, 

y Qonwhites, and the economically disadvantaged In Title VI, but there were 

. many exceptions to this generalization. 

;t The a^jl^lysis of the relationship between client service «iiiu tht 

charslcterlsticS of an estimatecj universe of need population providas further 
evidence that CETA client service patterns are not determined by demography. 
All. tKe changes in ratio cited represent changes that might be attributed 
to the demographJ.c make^^up af the eligible populations. However, these 
changes, may alfeo have been the result of many other factors, Over many of 

• which pr^ime 'iyjonsors can exercise control. All of those changes in the 
direction -of larger gaps between those served and those present in the 
estimated universe of" need are clearly ^ot demographically determined, 
Since the level of participant service and the composition of the estimated 
universe of need are moving farther apart. The. presence of a number of 
these types pf'^^changes in the data jixst analyzed indicate^^that demography 
alone does not determine client service levels.* 

4 . To conclude pur description of client service patterns and the 
relationship between Service levels an(j^ the universe of need, the rankings 
of the national sites shown in Tables 22 and 23 were developed. Tn both 
tables prime sponsors were indexed according to their absolute level of 
service to the economically disadvantaged. The decision to rank tlie' 
prime s'ponsars in this way was based on a number of considerations. First, 
es explained above, the unavailability of comparable universe of need 
~ data on this characteristic for all the prime sponsors being studied made 
the use of the ^enrollment/ESARS ratio not feasible. Second, the universe 
of need always includes many more people than any prine sponsor can serve. 
Thus, one important consideration is the criteria used in selecting CETA; * 
participants^ To the extent that need factors are emphasized one could 
expect to find a^high percentage of economically disadvantaged participante 
in any type of prime sponsorship. Therefore, although we recognize the 
importance of takiyg into account demographic constraints in evaluating' 
client service reco^e, on this charaotefristic a ranging bused on ebsolute 
♦levels of. service is justifiable. ^ \ 

Prime sponsors have b<^en* ranked according to* the size of the ratio 
* between their service level and th^universe of need estimates for .females 
and nonwhites. The highest ratios were given the highest rank. This ^ 
type of ranking syst^ was preferred^pcause it eliminates the impact of 
differences in the demographic makeup.of the prime sponsorship in evaluating 
, client service Records. Thus, high'^rankings on all three character^tics 
can jbQ taken as an indication that a prime sponsor is serving a high v . 
^ perdent^ge of economically disadvantaged in absolute terms, and avhighi 
percentage of women and nonwfiites id relative terms. ^J!!^ 

' . jC-. - . r . - , ^ . 

One Qbaeirvation that the Title I ranking shown in Table 22 supports is- 
that high rates of service to the economically disadvantaged is not 
uniformly related to high rates of service on the other characteristics 
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.Table 22: RELATIVE S^iRVICE TO' SELECTED DEMOGRATIIIC GROUPS, TITL£^5?^ 

NATIONAL SITES, SEPTEMBER, 1976 



Prime Sponsor 


Economically 
Disadvantaged 


Nonwhlte 


* 

Female 


Rank 


Percent 


Rank 


Enrolliltent/ 
ESARS Ratio 


Rank 


Enrol'ltaent/ ' 
ESAB3 Ratio 


Ciitnberland. N.J^ 


1 


100 


14 




1.21 


4 • 


•1.26 


DcTivr r 


2 


91 


3 




4.15 


2 


1.31 


Lowell 


3 


~^87 


1 






14- 


.77 


Birmingham 


4^ 


. 86 


12 




1.36 


■ 11 


.93 


Klng^'Sndhomlsh 


5 


82 


6 




2.45 


9 


1.04 


Duluth 


0 


/o 


/, 




3.20 


J 


X • <C0 


Dallas 


7 


78 


11 




1.38 


10 ■ 


1.04 


Sacramento- Yolo 


8 


76 


9 




1.58 


7 , 


1 .11 V 


Arkansas 


9 


73 


15 




.69 


6 


1.13 


Connecticut ^ 


10 


65 


10 




1.50 


13' ' 


.78 


Central Iowa 


11 


64 


8 




1.72 ' 


12 


.83 


Cumberland, N.C. ^ 


12 


: 61 


13 




1.27 


15 


.74 


^^i^uzeme 


13 


61 


f 

7 




2.00 


5 

■» 


. . 1.21 


Wilmington 


14 ^ 


60 " 


: 5 ' 




2.50 


8 


1.09 


Yonkcrs 


15 


52 


2^ 




4»64 


1 


1.37 . . 
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• Table 23: RELATLVE SERVICE TO SELECTED DEMOGRAPHIC GROUPS, TITLES II 
AND VI COMBINED, NATIONAL SITES, SEPTEMBER, 1976 ^ 





Economifcally 
Disadvantaged' 


Nonwhite 


— 

Female 


Prime Sponsor 


Rank 


Percent 


Bank 


Enrollment/ 
ESARS Ratio 


Rank 


Enrdllment/ 
ESARS Ratio 


f ^ 

Cumberland, N.J. 


1 


98 . 


7 


1.11 


4 


1.Q3 


Yon^cers 


2 


.70 


2 


2.36' 




.68 


Lowell 


3 


58 


10 


1.00 
f 


8 


.73 


' iving~bnonoiDl8n 


3 


58 


6 


1.35 


3 


1.04 


•Denver 


5 


56' 


1 


4.08 


1 


1.13 


Sacramanto-Yolo 


6 


55 


4 


1.65 


5 


1.00 


Duluth 




43 


5 


1.60 - • 


2 


' 1.06 


Wilmington 


8 


.42 


3 


2.10 


5 


1.00 


Cumberland N.C. 


9 


40 


9 


1.02 


15 


.42 


^ Connecticut 


10 


37 


13 


.81 


13 


. .60 


Arkansas 


11 


33 


15 


.50 


14 


.50 


Xu^eme 


12 


31 - 


10 


1.00 


- 7 


.76 


Dallas - ^ • 


13 , 


2,3 


14 


.50 

* 


11 


.66 


Central ^owa , 


14 


22 


12 


.91 - 


9 


.68 


Birmingham / 


15 


4 


8 


1.07 


12 


.61- 




shown. A number of the sltc^ that rank v6ry high -In cervice to the 
economically disadvantaged have low ^p«tillngs on service? to nonwhltes and 
women. Conversely rome of the sites with low rankings on service to 
the disadvantaged hav^ very high rankings for service to women and 
nonwhltes. Sevrral primes have consistently' high rankings across partici-__ 
pant categories . 

The PSE rankings shown in Table 23 are more consistent across client 
categories. Prime sponsorships serving a high percentage of economically 
disadvantaged participants with PSE slots tend to rank high on service to 
women and nonwhltes. The opposite pattern also holds. It is also 
interesting to note that there is a strong relationship. between hi3h service 
^o the/econooically disadvantaged in PSE and high service to this groyp 
on Title I. Thus, the -rankings shown in Tables 22 and 23 are similar, with 
a few notable exceptions . 



Local Programmatic Decisions 

We have hypottresized t^at program and service deliverer selection^ 
partially determines'' the type of participant served*, typically, work 
experience is ass;)^:iated with higher service to the economically disadvan- 
taged and nor)whites while an emphasis on PSE has been associated with a . 
relatively lower sl^ress en minorities and the economically disadvantaged 
(see Perry and others, 1975). The available data from the national 
sites do not permit a conclusion concerning the direction of causation 
between program |nd client choice. The strength of the relationship 
between program expenditures and participant aervice patterns, however, 
can be examined . ' 

/=^able 24 presents the relationship (simple correlation) between the 
dfytributian of expenditures on the four basic types of Title I progriams 
and the enrollment of the three demographic groups in which we are most 
interested for June, 1975, and Jurte, 1976. Only the correlations' 
involving PSE for the. disadvantaged and women were significant at the .05 
level. Title! PSE is not associated with high levels of service to the 
disadvantaged arid, like all PSE, is not associated with high levels of 
service to women. 

The relationship between percent work experience and percent economi- 
cally disadvantaged participants was very weakly positive in June, 1975, 
and virtually nonexistent in June, 1976.. When the relationship was 
viewed over all time periods, the result obtained was a correlation of , 
0.12. (It fs likely that the relationship would have been stronger if the 
two balances of states had been omitted. A large percent of Title I is 
allocated to work experience programs but service ^o the disadvantaged 
ranks fairly low.) 

A weak positive relat^lonshlp waS found between percent work experience 
-and percent whlte^ in June, 1975-. In June, 1976, l^jwevet, work experience 
was more associated with nonwhltes. /in both quarters, percent female was 
positively related to work experienc^. . ^ - . 

The remaining relationships of interest include the relationships 
be.tween OJT and classroom training with economically disadvantaged. A 
negative relationship between OJT and economically disadvantaged was 



Ti>ble 24r CQT^Pr'TION BETWEEN TITLE I PROGRAM EXPENDITURES- AND E!ffiOLLMENTS 
OF SELECTED i)EMOGRAPHIC GROUPS, NATIONAL SITES, JUNE", 1975 

• AND JUNE, 1976 * 





Enrollmfents 


?c "ontage of 
Expenditures on: 


% Economically 
Disadvantaged 


% White 


% Female 


6/75 


6/76 


6/75 


6/76 




^ 6/76 


Clr.ssroom 
Training 


0.34 


0.23 


-0.43 

« 


0.19 


-O.OA 


0.02 


OJT 


-0.28 


-0.08 


0.01 


0.42 


0.07 ' 


-0.28 


Wprk • ' 


0.11 


0.Q2 


0.31 


-0.24 


0.37 


0.32 


Experience 














PSE 


-0.59* 


-0.53* 


-0.03 


-0.20 


-0.69* 


-0.46* 



* = significant at the . 05 level. 

I 



f^' ' 61 

i 

, observed for .the two^tlibe periods (^nd Intervening quarters as well) • On 
the other hand, positive relationships x^cre found between percent 
expenditure on cla^iroam training and percent econot^ically disadvantaged. 

A similar analysis was undertaken for the Ohio prime sponsors.' The , 
same* inverse relationship between Title I fSE and percent economically * 
disadvantct,uu was found in both quarters. However, positive relationshl;»s 
were found between Title I PSE and percent white and Title I PSE and 
pmecent female in both quarters. The relationships between work experience 
and economically disadvantagedLand percent white were .positive, the scma 
as in the 15 selected sites. He relationship between work experience 
and females is negative, implying that increases in expenditures, for 
work experience are associated with decreases in service to femalies in 
Dhio, which Contrasts with the national sites. 

These relationships suggest that the types of programs funded can 
have a noticeable effect on the resulting levels 6f service to certain 
client groups. However, the (;}ioice ot service dellyerers is also very 
important in- this regarci . Central 61ty community^^^ased organizations 
often serve a very different* mix of participants than a subarban service 
deliverer in the same type ^of program. Thus, plrime sponsors have to take 
into account the history of a deliverer's service to particular groups in 
attempting t-o establish a delivery system that maximizes Client gep^ice 
goals. The general point, which the findings reported^bve support, 
however, is that program choice does have an important and definable - 
effect on participant service. We would expect^urther research based on 
program-specific participant dAta to support this point. 

Economic Conditions Demographic Characteristics, and Programmatic 
Decisions Considere d Tog ether ^ - 

In this section We attempt, throygh" regression analysis to sort out 
the independent impact of unemployment, basic demographic composition, 
universe of need, and progranjraatic choice on p^terns of CETA service to ' 
the ec&nomically disadvantaged,- nonw)iites, and females. Sepaxfetre 
regressions were run for each of the three client characteristics for 
all titles for each quarter* The discossion in this^ section will focus on 
selected results obtained for June, 1975, and Septembe^, 1976. 

When- percent Title I white in June, 1975, is regressed on the' above 
set of independent variables, only one varialjle— percent white in ESARS 
population, proved^to be significant at the^.05 level. For every unit ~ 
♦change in the ESARS population, the percent white increased 1.5 units. A 
negative impact on percervt white' of the unemployment rate, althou^gh not ^ 
statistically significant, was obtained. Of the program expenditures, n 
only percent OJT and PSE entejf^ed into the equation;- the impact of the 
other two was too small to be calculated. Expfenditures on- OJT and PSE 
exerted a positive impact; the results, ^however, were not statistically 
ignificant. / ^ 



In September, 1976, the same 'positive relationship between percent 
white in tl^ ESARS population and percent. white served was in evidence. 
The remain *r of the independent variables did not produce statistically 
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significant results. With the ESARS variables providing the bulk of- 
Lanatory pcwe^, the/ R^ obtatned was •59.1^ 



^r both quarters the "percent Title I female" regressions produced 
no statistically significant coefficients. For June, 1975, the following 
variables had a positive sign: percent female £n ESARS population, percent 
^ork expc^^^leuce, percent female In unemploye^census population. Only 
percent PSE expenditure^ exerted a negative JppaCt. This latter 
r^atlonshlp-was again obtained In SeptembeM^ 1976. In addition fo the 
above variables (which all were positive) the r ollowlng,^xplanatory 
variables had positive signs: eiependltures on classroom training and OJT 
and the unemployment X||te. * The adjusted R^ for each quarter was ^42 ^hd 
.46, respectively. . ^ ' 

The iiegressions for economically disadvantaged did ndt produce 
statistically significant coefficients. In Ju'he, 1975, only 3 variables . 
were entered into the equation: percent PSE, work experience, and- the 
percent economically disadvantaged in Che 1970 census population. The 
program variables w^re negative and the census vaiJlable was positive. 
^ The adjusted R^ was .18^ In September, 1?76, more variables were fentered 
but none were statistically significant. PSE, OJT, and classroom training 
expenditures produced negative coefficients whil^ percent economically 
disadvantaged in the ESARS and census populations and the unemployment 
rate^nad p6sitive signs. ' . ^ ^ 

The same type of analysis'^ was done for Titles II and VI. The nunfcer 
61 independenlj variables was reduced as there was no reason for including 
Title I program expenditures in the equation. The census, tSARS, and 
unemployment variables remained. In June, 1975i none of these variables 
were found to have an impact on the percent whites served in Title 11. ^ ^ 
In September, ^31976, only percent unemployed who were white in^the census ^ 
was found to h\ statistically significant at the .05 level. .For every 
1 unit change in the-4a<Jependent variable produced there was a .70 change 
in the dependent variable. / 

«?In both .quarters the percent white in the ESARS popuiatipn was the ^ 
only statistically signlAcant variable in the Title VI white equations. 
In both quarters a strong positive relationship was revealed.' 

• 

The regressions for Title VI females did not produce any significant 
coefficients. Similarly^ the Title VI economically disadvantaged y 
^quatipns dld'^nbt ifesult in an^ impacts that zn^ the .05 Significance levels 

^* ^ 



— AdJjtfsoed R is an R statistic adjusted for the number of independent 
vari^les in the equation and the number of cases. It 1% a piJre conser- 
vative estimate of th€ percentage of^ variance explained, especially when 
pf\e sample size is small. . . ^ ' ^ 

Adjust;ed R^ - Fl^ where K - number of Independent 

ables. . VN-K/ ^ ^ » . ^ 



varlab] 
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It is apparent that the host, of exiJlanatory varlc^bles utilized thus 
far do not adequately^ explain, the variation in client service patterns 
observed among th'3 Titles within a prime spoiTsorship and across prime 
•sponsorships. Wlille they have pro^ijied «in teres ting 4-n8ighti3 Inia. the 
relationships between program participants and certain theoretically 
relevant variables, they provide jrfn incomplete picture of reasoils for 
client serviv-w. J| is necessary to look at othe.r poa$ible explnnations • 



Attitudes; of Influential Actors ' ^ • f 

The general direct impact of .local economic cond^-tions' and fllctuationr; 
has been discussed. To re-emphasize an important polnt> we have- thus far 
noted that local social and economic conditions are not directly translated 
into participant service patterns:^ Rather, social and economic conditions 
are filtered through the perceptions and preferences of»manpower actors: 
political officials.'^rlme sponsor spaff, manpower planning council 
meid)ers, and ^Service deliverers/ This section reports evidence on the 
relationships ^^tween manpower actor preferences and particijpant service 
patterite, ^ •x. ♦ 

VJe'^sought data on *the attltudMFof all manpex^er actors in the national 
sites abou^ preferred client servl^|patterns • The results of this survey 
permit a ranking of the national sizea according to their desire to 
serve ecohomlcally fJisadvantaged, nonwhlte, and female clients • This 
raking was then compared with the ranking of actual service pattema 
(measured here in absolute percentages)'. In general, we found a high degrea 
of congiHience ^tween the attitudes of all manpower actors and the relative 
degrees- of ser^Pbe. For example, congruence between pieferences for^ 
service to females in both Title I and PSE, and actual service patterns was 
marked in 11 of the 14 prime sponsors for which •data were available. 
And^the fit obtained between preferences and service to nonwhlte^ in ^ 
all Titles was also quite good. A bJLt more slippage "was evident in the 
economically disadvantaged category with 9 of the 14 prime sponsorships 
achieving high degrees of congruence. While these data are preliminary, 
^hey lend^ support to the general argument thatf prime sponsor manpower 
actors oan exercise a substantial measUre of control over tfie nature of 
participant service patterns and that the resultliig-^pattems accord closely 
with their general preferences. 
• * 

We also attempted to weight the preference^* of the actors in terms of 
their relative influence on decisions on the basis pf the assumption that, 
actors who are not Inf Itisfhtial in decision making should not receive the 
same attention as those^hat are Important. For Title I decisions we found 
that the prime sponsor staff was influential in all but two prlme^ sponsor- 
ships. In the 13 prime sponsorsl>lpS' with high staff Influence there axB 
clear relatlonshl|)S between the preferences of the'sfeaff and service to 
the economically dftadvantaged. Prime sponsorships that served relatively \ 
fewer economically disadvantaged also tended to be managtd by staffs with 
a weaker commitment to serving this group, while staffs that had sttong or 
very strong preferences to serve the economlcalJLy disadvantaged in .fact 
did M. In tfie two cases in which staff preferences were not followed in*, 
actual client service patterns, the impact of the attitudes of pcxlitical 
officials were felt. In these two cases political off icials 'were influen- 
tial and had no commitment to serve the most disadvantaged. I^^ should also 
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))e added that in one case* both the political fef ficlals aiicl the staff 8hareJ\ 
a very strong .comiLlt^nent to the ihc^st disadvantaged and thlS was reflected 
1^ a high SjCrvics to this group. 

In PSE dar^sioiis,^ ti/e have noted above, political officials played 
'4 more Wki%i^l role_^ thla selec^on of clients. In nine of the 1^ sites 
we founS the*: 'political d^icials w«re ve^ influential or influential in * . 
the^et^rminaticn}of P52 client patterns, in most 'cabeis (all but three) 
'sharing that influence with the professional staff, ikble 25 shows the, 
relationships between* fcoinmitment to serve the economically disadvantaged on 
theiiiart j>f Influential political' officials and the ifelative degree of ^ 
service. Tlie ttable reveaJLs that, prime sponsors wl^th Irelatlvely low actual 
service patterns to the poor are inf lu^ced by political officials who do 
not have n coinmitjient to serve the economically disa^yant^^ed. In the , 
two das.e&i in which higher levels of economically dlsa^antaged Were served - 
despite political of ficial preferenAt, Tie professional staff'^had a # 
stronger coipltm^nt, and^thu$', influen^d the results^ In addition, in thc< 
three prime sponsorships in which the |?)litlcal officials were jJBged to ' 
be the most influghtig^ actor dn PSE decisions, the actual service to/. # 
the ecHjpmically disadvantaged was relatively low— 42%-, 33%, and 31%. 

Equally *impor^nt ^re tlfe att^itudes of the mahpow« staff! Here , 
^ain.the commitment td^ei:vi*ilg the disadvantaged jinder PSE tended to be . ^ 
w^dc or nonexistent (often coijrespondlng to the ^^tltudes of pipllti'cal 
officials) and much lower th^ the levels descriVed for Tit}:^ 1/ Eight ^ 
;<tf^ the 'f)rime sponsor staf'fs had little or no conanitment to' serving. 'the 
crls advantaged in PSE, ^while only^ 3 staffs expressed such an-^tl^ude f6r 
Title I .pro-ams.. However, tt is' important to note that a coinrflttej|F' staff , 
ar^ elec^^pff Icials could, ifideed, serve Aisadvantag€vd''^ndividuais' with 

i^f^ CTid^^hose to do'so. Six of our national sites exc4!ed^ the 
national average- of^ 4A>? fot service to the disadvantaged. In September, 1976. 
Of these, four had staffs and/c^ elected officials that had,very strong 
commitilfents to fervirt^ the. poor and were able to implement tliese preferenoes, 

• S 

Manlp>o\A|| Advisory Council Influence and Activity r • 

W ' ' ' ^ !~ ] r % 

We analyzed the te^tionshlp between manpower advisoi:y council 
influence* and ^tivlty ^nd the resultant iilient^ervice pattern for the 
economically disaJvantaeed. In' general, we fdund that prlrte sponsorships 
with active andirlnf lu^ntial councilftiware equally likely to aerve higher , 
or lower>a)roporti6ns of economically ^i^dvantaged individual^' In the 
four causes ^n/which the council was '^nelftier axftlve nor 'influential, three 
of the prime sponsors served relative^ lower p^portions of eeonomically 
dpb advantaged in Title I programs. We haife observed that active i?cuncil8 
thatdre able to.exett influence sometimes act* as a force in favor of 
targeting lai*ger ifropo;rtions of fynds for the economically disadvantaged. 
Their ^ImJ^aTct. on, the selection of clieitts, 'n0weveir*j is usually indirect' 
and cojjke^ through their influence over the ies^nation of broad prime 
*8p0nsj>r goals ,^ucW. as significant «egment8;^fchelr' influence oVer^' . , 
prograninatic decislot^S '(for example, 'rfeduclng the amount of'^Tltle I Pu'bllc 
Service Employment); ^nd as a mechanism regtesentjj^^ *variou8 client ^ 
constituencies to t^e 'prime sponsor staff, service deliverers and. political 
officials. ftanpoBPrer advisbx^^ouncils, therefore, may have afi Impact on* the 
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Table 25: REL/rfO^SriiP OP JNFlJJEN'ifiLAL FOtlTICAL OFFICIALS ATTITUDES , 

TOWARD SERVICE TOm D1SADVAN3:AGED AND ACTUAL SERVICE^ 
TO THE DIPAD^VNTAGED WITH ?sk SLOTS, 9 NATlftNWL SITES, SEPTEMBER, 1976. 
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Attitudes of Influential 
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actual service *pat terns',, "but the liripac$ occurs Infrequently •and when It 
does It may or may not eifiltrge s%rviCe for the less advantaged Individuals. 

Specific Manag^fctot DecjLsions \ ^ ' 

Investigated stii^Jf experience and capacUYi the qiitllty of MIS, the 
mix of operating responsl^llty, the degree of administrative integration 
between Title I and PSE, ^d /he quality of program evaluation in 
Illation to client service ^tterns^. No strong and tinamblguous relation- ^ 
ships emerged from this analysis. In teny cases ^he amount of variation 
present among the IT selected sites on these variables was npt sufficient 
to produce clear relationships. However,' our own observations revealed 
many Instances in which these factors wete Important Jn determining the 
success of prime sponsors in achieving their goals. For ^ample, staf^f * 
commitment to serve disadvantaged clients was not always sufficient to 
prodtice the Intended result, but the more« capable staffs were better 
abl^e bo Implement their go^ls. This fSlght tatce tht form of using an 
effective MIS to help achieve the desired enriUIment levels for different 
ategorles of clients, or th^ establishment of rigorous evaluation 
procedures to encourage ^service deliverers to be more conscious of meeting 
their service goals. Thus, even though the anaj^ls did not uncover 
systematic relationshii^s that held across all 15pvl|^ sponsors between 
these variables and client service, it would be a mistake *to conclude that 
these factors did not have amy Impact on client Service levels. 

National Policy and Regional Ofq^ce Activities ^ 

Regional Offices of ML are* not very influential^ in the s elect ioo of 
clients ifor Title I or«PSE prograins. In only one of *he 15 cases was the 
reglonaf office representative judged to be Influential Jn the sel^ection 
of cl^nt^-^and here the individuaU^j^ Influence was ind^nrect — ^through an 
inslst]^nce^ on higher commitments to work experience t^rograms. In plan 
revle^t Regional Office staff rarely question prime spodsor analyses of 
Ti^W; although this has be^n done In two regional office^ with Spme^ 
^ effect.^ MoreovJip, the regions do not monitor the eligibility of 
enrollee^ Xt\ tlw programs , in an^ syselematlc manner . ^Most important, the 
regions do not attempt to determine whether the actual participant servi^.«; 
#|bP^tt&ms Q||rre^ond to the nature and incidence of need wlth,li\ ^e prime ^ 
^^^ons or ships . In only rare instances have individual fj.eld representatives 
been Influential in causing the local professional s^aff to re-examine their 
client ^service pattierns. But^hls task has not^ been part of the" routine 
analyses conducted by federal representatives. ' 

TVo recent trends on national policy seem to be having contradictory* •* 
Impacts on participant sef>vice pat^tems. The first policy, the development 
of and utilization of performance Indicators that stress cost per placement ' 
(without attention tc^ the tfype of individual, placed and the difficulty of ' 
that plaoem^nC) , has in some cases ^encourag^d prime sponsor^ to move toward 
V>re trainable and placeable l^lvlduals ( "creaming'*) , as evidenced by the 
^ increasing proportiona of thos^^ith more than a highschool education. 
(This may also stem from a shift away from work experience, which in some in 
stances has stemmed in part from DOL pjesjure;) 



Tlie other pollc)^ shift 'that hrn b'^en reflected Jri U*c ptirae ^onsor- 
shlpsjyia tho^. changes In PSE eligibility stc>ndar?Kand the announced 
intencipn d] the iiev Administration to serve less adv^ntascd indlyld 



1.^ uii»? ijcv Administration to serve less advantaged indlyldualL . 
while out data do not reflect^^he direct Impact of these changes,- prime ^ ' 
sponsor ataffs Bc^n to be reacting in an anticipatory manner: for 
example, they have been shifting the relatively more advantaged clients 
'from Ticl-^ V**" to title II and vice-veraa. ' ► < 

, In'genexal, then, the impact of the Department of Labor on'clJent 
service patterns *is minimal and indirect* But potentially It cou^'.d be 
important. The Department Has not concentrated its attention cn~>hir"' 
aspect of man powei^^ programs, though it has occasionally indirectly influen-- 
ced client 'cAjtccinas throiigh. policy decisions regarding permlssable progran^ 
The potential influence of the Regions is demonstrated by t'He few oases in 
C^hich ^the regional offices have had an impact ^tPour sites* Recent shlftis 
in national of flee. policy that promise increased attention to the question 
,of <he distribution* of benefits from CETA programs also carry the seeds of 
more DOL Influence. ' . 

Summary of Factors Explaining Participant Service Patterns - ^ , 

^ 1. The' mix of participants is related to the choice of programs^ 
By altering program emphasis, a manpower' staff can probably have ^n 
e^^ct on th^ characteristics of those enrolled. 



2. The demographic ch^acteristics of t^^popiiatlon' of the prime ^ 
sponsorship are not .deterministic with respec^^ to who is served.^ ^^anpower 
Istaff members retain a greatroeal of latitude*' over participant choice. 

3. Changing local economic conditions may affect the emphasis placed 
on service to ctertaim groups. These conditions do not, however, completely 
determi4€ the composition ol^a CETA program Jj^—t^rms of participants. Many 
options remain oper\ to the^ local nnagers about p^Mlcipants regardless of 
thfe nature' of the economic conditioro thpy face, 

' A. The attitudes of influential roahoower actors /are important in 
helping shape participant mix. Within a nramework of environmental and 
political constraints, policymakers* attitmtes toward who to serve c^n 
be enbe(lded in the choices made.' 

S 5. To the extent that they are Influential, political officials* 
impact on the nature of PSE ^participants Is grea^r tlian for Title I 
^participants . - 



6. DejgartiQedit of Labor policies and actions 4pa^L^ndirectly affect 
^artlcipant^servlce patterns, especially throHgh inattention. \ FedeVal* 
^representatives generally have little or no influence 0ver who\ets 
served; local decJelon-makfers ^re typically given free rein in Jthis area. » 

^The DOL emphasis on: perf ordnance standards ^eems to push prime /sponsorohips 
to' give less service to the iflost^/^sadvantaged ^s they seek tp boost their 
placement rates . • ' v. ' • , , . ^ 

• . , • ' ^ V ' .A 

7. Observations in individual sites si^^st that acflye aqd influen-^ 
tial advisbry councils may indirectly influence some of the condition^ for 
|he thqice of participants, but th'at their direct influence is ll^nlted. 
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8. Observations in irdividt'ol sites suggest that certain management. 
procc4urcs are critical to a well run program and therefore to a conscious 
choice of participants. To the extent that a staff has relevant \niver8c- 
of rleecf data^cnd control over intaRe procedures, even if decentralized, * 
the*directlo;;i c:;ertrd over who is served is enhanced. An accurate 
assessment of wha^ groups ar^ in most need of service axid the demographic 
composition : '^^appllcant^, and an up-to-date accountihg bf-who is being 
enrolled seen to be prerequisites for effective targeting of participants. 
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' IV. PROGIU'.M PERFORMANCE 

In the th:*?- progress reports f rom. thia project we raached a~ nmnber 
of tentative conclusions on links b^jjljreen management decisions and a ^ 
nuBAer of asrrcts of gcTal achievement. These conclusions were based^^n^ 
our observation(i*in the.-field at 15 sites. In the preseni: section we. want 
to focus. Oil prcgi^m performance in a more technical sense and relate it in 
a systematic way to ^ number of the farctors we have^ been exploring in^he ' 
previous sections on program design and management and the nature of ^-'^^ 
participants. Them in the following «€*ct ion— which contains our tnost 
general conclus^ions from the project — ^we will- rely both on our findings 
in this section and on our previous observations reported on the basis of 
field work to arrive at 9ome final, statements about- what Management decl- - 
^otis are likely- to have the most'^payoff for goal achievement under 
different conditions. The kind of analysis reported in this section and $ 
that reported in our progress reports are both valid and shoul4 be used ^- 
^ogether to reach well-rounded conclusions. 

We realize tha£ performance in manpower is a y^iTr complex topid and 
that^thcfre is no agreement amoijg experts on the b^st way eithei: to 
conceptualize it or measure it. We certainly .do not claim to have reached 
definitive ansWtrs on either cooceptuallzation or measurement but. we think 
tH^t the following analysis corttributes to the ongoing discussion of. both 
'aspects of analyzing program performance by 'prime* sponsors. 

What •follows in this section is organized in four majcn: parts: 

1. A general, comment on local goals and godl achievement. This is 
a vejry brief synd^Jsis of considerable detail contained In ►the three 
progress reports. ' - * \r 

2. A description of the systematfc^ anfl^lysis of perfoxmance that, we, 

undertook. - 

* / ^ - * ' u 

* ^ 3. A detail^d^ explanation of prime sponsor perf6r'roance in Title I 
programs. ' ' ' 

4; A very brief explanation p^itoe sponsor performance in -PSE pro- 
grams. ^ . ' ^ ' ' 

\\Jhere possllile* we used ^^at/ on 32 prime sponsors^ (both our 15 nation- 
al sites and oiir l7 ihic^i^siteA)^ ' , ' ^ ' . 



LOCAL GOALS AND GOAL ACHlfevEHENT 
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Part of the rhetoric behind the esttebllstaeat ofi CETA was that it 
would permit local jurisdictions to pursue igmploypiehtN^iii training goals 
that wer^ responsive to uniqii^ local needs. Although' national- gbals and 
standards would still be Vromujgated, sufficient programmatic latitude 
wpiild be given tcv prime sponsors ao>that the lock-step approach to manpower 
training presumably found under the^xategoric^l prragrams woujfd be avo^ded'i 



In our detailed field ||ork at* the 15 national sites i!«re made two basJc 
discoveries. First,, presuioed national g^alr* fot" CETA tended not to be "\ . 
very important at the pipime sponsor le^el* Second, there was considerabli 
diversity in the' local goals that had been^^etr We- speckled both the J 
explicit and iirpliclt local goals that had been adopted at each of the 
15 sites and also reached judgments on their level of success in'Tacjiieving 
the goal?. Corme^ies of these goals and our judgments about degree of 
sudcessjin aohieviilg theiii are contained in Appendix A. ^ ^ ^ 

Thte goals varied greatly In scopeT^ content, and le'/el of 6^blf*ousness. 
HoweverVwhen tfi3 goals from the 15 sites are considered Jtogetheriifcost^of / 
them fell into four categories: 

" \ - / ' 

1. Those dealing with placement and retention (13 prl/ne spoilsor-' 
ships had such goals). • v ' " J 

' 2. Those 'dealing with the nature of participants (12 prime sponsor- 
ships had goals/f ailing in this category). 

3. Those dealing with aspects of managing the manpoweii ^ysjjtem (12 
prime isponsoTships hflji such goals). \; 

' 4. Those dealing with* the nature of substantive program activities 
(6 prime sponsorships had goals of this character) .. 

The ptime sponsors had, in general, set reachable g^als for them- 
selves. Of the mcg^e than 60 individual goals at the 15 sites we judged 
that. they were attaining at least; moderate success for about 80% of th^m. 
Not surprisingly, the category with-the lowest degree of sttcte^s was^ ' ' 
placec^nt/re tent ion. . * ' ^ # ^ 

Relatively low suipcess levels also tended to appear in relation to 
goals that hadi only recently been adopted. In these instances the prime 
spoftsor^had not* had much time to effect-desired idove^kit toward t\ve goal. 
Poo/" success was al^o likely in cases of goals^ that^iwe o^^rly ambitious 
and/or ambiguous. ' ' ' ^ ' - ' 

* Limited goal achievement in the shojrt run, especially in the place- 
ment/retention area, should not necessarily be equated with poor *perfor- 
mance by the CETA program. But, of course ^ in the . long rvin pr/cJgrams that 
do not achieve^ their goals, including 'thbse -in the vital areas of placement 
and retention, cannot be judged sucpes^^ul^ - , 

There is' an important association betweien.the priority giyeo .each goal 
by the professional staff and the level of goal attainment • Higher 
priority goals yere more likely .to be achieved than lower priority goals. . 
rlore than simple pronouncements of goaltLntentiotts are required' for a 
high degree of goal achievement. Commitment of re^ourdes and clear, 
deliberate means-to-ends actions/^a^e .also required* And these necessary 
ingredients are more likely iirtiere the staff consciously thinks of a goal , 
M h-igh priority. Rhetoric, '^in fact, matters* 



Two additional factor'; most c'osaly associated vrlMi a high degree of 
goal r.chleveinent vjcre quality of Sitaff aid the location of program operating 
responsibility, ^irsn, those sirritne spofiGorsHips with staXfs that we . * 
judged to be of Iilgiinj nuali ty?^ti^ others also , were achieving th'^lr goaLs 
better, perhapc ia ^crt becaasath^ staff was sin:.rt enough to set reachable 
goals. Second, those priise spon^o^lj^ips thatl contracted out all service 
delivery ter^^rd to do better in goal achley€m*nt'*tfian those that kept 
part or all of the system for In-house operatu>n and delivery, 

THE NATURE OF THE SYSTBhfiVTIC ANAI^YSIS.OF PERFORMANCE 



)^IAN( 



There are three principal ways to approach assessing program perform- 
ance systematically. First, one can use a descrtptive approach, slnply 
comparing' F^lHie sponsors on different program performsmce measures. A 
second* appxoach is explanatory , asking what factors are related to change 
in program performance, under what conditions relationships are enhanced • 
or depressed, and what a prime sponsor staff can do. to change performance. 
A third approach is normative , asking how prime sponsors' performance on 
different measureo compares to preset ranges of acceptable performance, 
* • > 

Although none of the approaches' is without difficulties, the explana- 
tory ^pproat:h has been used here for several reasons. First it yields more 
information use^l to'a prime sponsoiH staff . because it addresses questions 
of why and how program performance changes, it has the potential for 
providing the staff with guides on what to do to alter performance. 
Second, this. approach Is less arbitrary than tbe normative approach 
because it avoids labelling prime sponsor performance as good or bac^on 

^ ^e basis o^^ Gomparlsonk to some (arbitrary)^ limits-sat £or-a.pei;formance 

^X^ndicator. ' . • 

A major focus of the ^planatory approach used here has been to 
identify what the* prim/e^ponsor staff can do to change program performance. 
We have tried to identify a number of fiactors that affect pgrformance, but 
we have been especiaily sensitive to factors over which t»staff has 
some control. \Aile it may be interesting to know 'about program performance 
differences in rural consortia compared to urban prime sponsorships » there 
is little a staff can do to change the nature and a^^mposition of a prime 
sponsorship, even if such a change might improve pejpf oonnance. ^ It is more^ 
ijGe£ul for a staff to know whether factbrs that *are subject to at le<^t. 
partial staff control, such as spending for different program^ activities, 
are related to changes in program performance, ^ 

Discussion of Explanatory Factors <^ % ' \ * 

' \ ' * ' 

' There are many factors that can affect prime sponsor program, 
performance and goal ^fTTh^vement # ^Some factors can be readily identified 
and measured while o»ers ate more qualitative in nature.- The general^ 
factors we examlned-»5xn . the following exp}.anatory analysis Included s^taff 
charaQteristics and' activities, involVejuent of actor^ other than the, staff, 
in manpowar,* character la tics of participants ^served, expenditures for 
program activities, enrollment^ by program activities, economic conditions,' 
and size of the Title H>udget allocation. Table 26 SiUBOiarlzes the^pec'ific 
indicators *us^, and indicates the relative degree of staff 'control over 
e^h feature analyzed. • Within the three basic categories of degree of 
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Table 26: EIO'LANATORY FAC T ORS I'SED I K A[^YZI IT(rFSRFORIlANCE /I^D 
* DFCnEE OF STAFF CONTROL OVCR THEM v 



Factors over which staff has little or no control. 

I. Utiemployment rate 

. 2. Fundings' allocation trend 
' 3, Pre-CfeTA staff experience 

4* Administrative integration for Titles I, lis afnd VI 

Factors over ii ^lch staff has some control 

^ — ^ — . 

5. ' Quality of top staff 

6. . Quality of all staff 

7. Location of operating responsibility 

8. Jjivoivenent of business 

9« Involvement of advisory council p • 

10* System-wide commitment to placement ^ 

II. Level of conflict • • 
12 • Quality of program evaluation 



? 



Factors over which staff has r,elatively high control 

13. Staff commitment to placement 
A4^^. Quality. .gfy 4) rogram monitoring 
15 • Participant characteristics 

16. Expenditures for program activities 

17. Enrollments by program activity 




staff control no fank ordering is Intended. A brief dlsca^sion of each 
of the factjors analyzed in relation to performance^ follows. We had data on 
all but numbers 8 and 10 for 32 prime sponsorships (both the national eltBB 
and the Ohio sites). For numbers 8 and 10 we had data only on the 
national sites. . - - ^ 

1. The unemployment rate was measured using monthly figures reported * 
by the- Bureau of Labor Statistics*. An unemployment rate for each 'quarter 
was obtained by averaging the 'unemployment for 3 months. The quarterly . 
unemployment rates in individual primes we.anal/eed ranged from 3.7% to 
14.5% between^ September, 1974, and December, 197&\ ' . 

> ■ r Z 

2. Funding allocation trend was measured as the percentage changes, in 
Title I allocation between^ FY 74 and FY 77. In FY- 77 the prime sponsors we 
analyzed received between 73% and 338% of their FY 74 funding levels Cthe 
national average was 107%) . ^ . 

'3. The level of pre-CETA manpower experience was measured by the' 
number of professional staff who had been involved in manpower prior Xo 
CETA. Two groups of prime sponsors emerged — those with less than one 
quarter of tKe staff whp had^ pre-CETA experience (20 prime sponsors were 
in this group), and those with a greater 4>roportion having pre-CETA 
experience (12 prime-. sponsors were in this* group). . , ^ 

-4. Administrative integration for Titles I, II, and VI is, in most 
cases, a basic decision^ ithat was made ^t the beginning of CETA ^n each 
prime sponsorship and, therefore, is subject; to a low degree of staff 
control at ^ra^ent. The possibilities. range frotn.tbtal separation of the 
' titles (with separate sta^ and even diffcerent physical locations) to 
Complete integration, with all three titles administered by- the same 
persons. Prime sponsors formed two groups on this measure, 23 with low. * 
administrative integration and nine with high integration. • . - 

^ 5, Quality '6f top staff and 6^ >quaj.ity^f all staff are measured 
on the^basis of our field teams* judgments. The ratings ,^f very good, 
good, and fair reflected our cc|fcpsite judgments abojit' the professional 
capabilities, experience, and ql^l^^ ^cations of the professional staff. 
(SJ^teen prime sponsor^ had very goo^ top s.taff, 12 had good top. staff and 
4 had fair' top s^aff. Eleven prime sponsors had very good staff, overall, . 
15 had gdod staffs, and 6 had fair staffs.) ; ^ 

7, Location of operating responsibility refe'Ts. to the nature of 
program operation — whether responsibility for service ;de livery Is primarily 
retained by the CETA staff or virtually all subcontracted to external 
.deliverers or somewhere in between (mixed). Among the 32 prime sponsors 
studied, five retained a high degree of operating responsibility, 15 
subcontracted for all services,* and used A mixed approach. 

8. Involvement of business ' refers to ^the^ degree 'of business 
participation in CETA solicited by the manpower staff. Prime sponfldt's were 
dichotomiMd into low involvemenf and. moderately hj.gh involvement. Data 
were not available for the Ohio- pr line spbnsorships for this toeasure. Of 
jtlMft national sites, nirte had low involvement and had high involvement. 
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I nvolvfemer.t of ^ he a dviso ry counc il was jjdged to fall Into 
IcvolFF tliooe'^chst were both active and influential 



9- The 
one of throe 

(il caces) tiiosG that uerc active but not influential (12 cases), and 
those that were nai her active nor influential, (9 cases). Our Judgments 
were based on th3 f re^. lency of meetings and t'le extent 'to which council 
recommendations w€fre accepted and implemented.^ 

10. , .Syslem- wide coi gmitmsnt to p?acomgnt is a composite measure of 
the importance uith which placement was treated as a goal for -Title I by 
each of five groups .(staff , political officials, advisory e©uncil members, 
service deliverers, and regional office). T^e prime sponsors cluotcrcd , 
into those with moderately high overall commitment (6 prime sponsors) 

to placement and those with low overall commitment^ to plaiCemerit (9 prime 
sponsors) . We were unable to include the Ohio prime sponsors, orj this - 
variable because of lack of data. , ' 

11. The level of conflict reflects the nature and extent of mani^ower" 
related disagreement's and conflicts among diffei:ent actors in the prime ^ 
sponsorship. Three groupings emerged — low o^ ho conflict (15 prime . _ 
sponsors) moderate conflict (5 %prime sponsors), and relatively hig^i 
conflict (12 prime sponsor^). , 

12. . The quality of prog|^m evaluation was Juj^ged on the basis of 
both quantitative and qualitative aspects of evaluations performed by the 
staff and the range of sei^ice deliverer^ evaluated. Three categories 
emerged for this .measure: high quality (4 Cases), moderate; quality (12 
c^es) , and'low quality (16 cases). « 

13. Staff commitment to placement is similar to the system-wide 
commitment measure discussed above. The staff commLtment variable refle^?ts 
our judgment about the extent ^o whic,h placement wai articulated andf regard- 
ed as a seripus goal fot- Title I by the s^faff. Prime sponsors were grouped 
into those in which the staff conaaitment to placement was explicit and 
strong (13 prime sponsors) and those where staff commitmeat was' limited 
(19 prime sponsors) . . ' . * * . ' » * ^ 

' J ' ' 

14. The q uality of monitoring refers to^he staf^ ^pervislon bf - 
the service daliver^rs and staff unit$> responsible for program delivery. 
Prime spoHigors were judged to ha^^fkl^^, -medium, or low quality monitoring' 
depending on the nature and exteM^prSioAiroring visits, and t\\e range of % 
servicci deliverers monitored •- ''J^re wer^ 10 prime sponsors with hfgh _ ' 
quality monitoring, 13 with-^^edldB^ 8' .with low quality. One 
remained unclassified ' ^ 



15. Particij)ant cha j jfc fcristics fncluded me^asure^ involving six 
different groups : Llie ect^Milcally disadvantaged, welfare recipients 
(AFDC .and public assistance), th#s'e with* less than a high s chool -education- 
or eqAvalent,* fema^s, unemp-loyed,^ and nonwhites.. These characteristics • 
were" chosen to represent participants ^whd would presumably be more difficult 
to serve than others. A percentage for each ^oup was calculated simply 
by dividing the^nuirf>er tn each group by the total number enrolled. The 
ranges for individual prime sponsors from December, 1974, through December, 
1976, were as follows: . r , ' • 
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Z economically disadvantaged 0 - 100%^ ' - 

4 % welfare recipients ; 0 -75% 

% le#S tfian hlph p.cfiooi 15 - 96% ^ 

% uneraployc'l • . 0 - 100% ^ > ' ^ 

% females ^ 6-62% ^ I 

% ncnwhltes ^ 1-89% ' w.. 

16? Ex penditures^ ^r prtgrqm aLT-tiviiieg^ weretr calculated for classroom ^ 
trailing, OJ'fi^ work ex^rience, fSE, and services usipg accrued eKpenditureo f 
for each of these activities as reported <jji*the Financial "Status Rap6rts^ 
and the Quarterly. Progress Reports and dividing by the total accrued ^ 
expenditures. (Classroom training expenditures iWfcludcd only prinje sponsor 
funds,. n6t 5% vocational education money.) The percentages for each prograai 
activity ^or individifll prime ^|>on80rs f^om December, 1974, through. 
-Decend>er, 1976, ranged as -follows: - , ' ' ' , . 

% classroom training expenditures 0 - 86% 

^ OJT^ expenditures ^ ^ ' 0-42%- 

% workv experience expenditures 0 t 9*7%". . V 

% PSE expenditures ^ . . 0 - 685J I 

% services ext)enditures* ^ » ^ 0 - 60% . ' ' 

^ 17. Enrollments by proRram activity wer^cojtnputed for classroom 
training, OJT, work experieiy:e, and PSE^using data reptjrted on the Program 
Status Sundry and (Juaitetly Progress Report forms. (Participants enrolled 
under classroom training with vocational education ^unds^were not 
included.) A percentage was calculated by dividing the nu^iber 'of people 
^seiVed'in eaph program activity by the total number of^people served. 
Th^ range of percentage for each category , for individual prime sponsors 
from^ December , 1974, through Decemberj^ 1976, was as follows: * . 
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% classroom training participants 0^ 95%4. 
% oJT participants * ^ . 0 - 54'%' ' ^ 

% work experience participants • 0 - 100% 
C% PSE participants \ 0 - 51% , 

Discussion of Performa nce Measures , . ; 

Sefection of the measures to use in evaluating Drlme Sponsor perfor- 
mance is not a *neutral exer^i^e. Different mea-^ures Nwill emphasize orNfail 
to emphas;tze diffeteot asp.ects bf program performance^and prime sponsors 
will rank differently on different measures, tte Department o^f Labor . 
and prime sponsors have been f(i conMnuing discussion, debate, and 
negotiation ovef the selection and ^plication of national performance 
indicators, j (The latest draft was being circulated in April, 1977.) A 
key issue in the debate involves identifying factors -that <ian be producing 
a poor ''score" ^ a given performance measure, and sug^gestieg how such a 
factor should be taken in to^ account (The staff at Cleveland Area 
Wedterti Reserve Consortium have produced s^eral w6rking papera dealing 
with this ^i^B^ See Mackie and'Besek (1976) and Mackle (1976).} 



.We recognize the controversial nature of p^rfonpance indicators, 
and do not expect to satisfy all parties with tfie Indicators selected for 
use in this analysis. But by using several indicatots of both terminations 
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atid costs, we hope to captui3 differences Ir perf armance- that would 
Uhdetetted wifl/ only one measure. ^ The measures used did tap different 
dlfflenslons of pirTo>Tinnc^. (See Appen<lix B for a correlation matrix 
between the indicator^ that- supports t'ils assertion.) In ali; csfees, 
the Indicatora i;sed In this section re Elect*- actual performance, not • ^ 
planned performance, and In ^11 cases the sourt:e of t;he data used were the 
% quarterly rcp'^rts 8uJ)mltted by the pr5me sponsors i:6 "the /regional offices* 

There, were several measures we were unaljle to lise In our analysis of 
program perfoirmance that, ideall} , should be Used. EconoMc inpartt of 
CETA participation on the persons enrolled is, in principle^' an important 
_ performance jmeasure, J.t_i3, howcV^r, very difficult to obtain 
appropriate data for measuring econfomlc impactl The federal Quarterly 
Sutamary of Participant dharacterlstj^c forms indicate the number of placed 
participants' who earned different levels of wages (from less' than $1.00/hoi/t 
to $6,00 or more/hour) ^bef ore and aft«r CETA participation. Unfortunately > 
the quality of the data^eport'ed by prime sponsors to the Department ^of 
Lab6r does not allow us to construct a valid wage gain measure. None of 
the quarterly reports contain informattion on whether the placements 
obtained by the prlm6 sponsor \jere t^raining related or not, nor is tjiere 
information available on the duration of placsaa^nts obtained or on ^^Ke" 
relative quality of placement^. ^Although all of theSe featured are 
acknowledged to be Importalit aspects of prime- sponsor placement activity, 
there is no m^ans of including' ttiem In a systematic asso^sm^nt of placement 
performance at this time* 

^ The termination cluster we used includes" five specific Indicators. • 

The cost cluster includes three specific Indicators. 
■ . ^ 

Termination Cluster Indicfitors . 

1. Placement efficiency is a measure of* the overall effective- 
ness of CETA as a mechanism for getting people Into'nmsubsidlzed employment. 
It is calculated as the number of people entering employment divided by tha 
number of all per&ons enrolled. The m^^isure indicates what proportion 

of people who are enrolled end up with a job^ ^ 

... - V . 

2. ^ CETA placement rate is a similait kind of measure, but it 
narrpws the focys even n^ore by" indicating what proportion of all , / ; 
enrollees ,get a jofc after receiving CETA sejA^lcPS other than ass'essment 
and referral^ It Is calculated as the numb.er of indirect placements 
divided by the number of people enrolled. ' 

\ ' / • ♦ . * 

3. Indirect placisment rate is caicula-ted as the number of 

, Indirect placements divided by the number of people entering employment. 
This measure indicates yhat proportion of the people^ who got Jpbs had 
received $ome CETA services other than assessment and referral. 

/ 

I 

'4. The entered employment rate indicates what percentage of the 
people who leave a CETA program do so because (hey got a" Job* It is 
' computed by dividing the:nuni)er of people enterttijg eraploYitent by, the total 
_ number of terminations.' " ' 

. * 5. -Monpositive termination rate is the number of rtonposltive 

terminations divided by the'nu]|d)er of total terminatio^ia.^ It indicates 
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the proportion of people who are leaving a CETA program for reasons other \ 
than getting a job, going back to school, j9lalng the military, or 
other "p^Dpitive" reasons.^ * 

Cost Clustor Indicators * ^ . ^ ^ ^ ^ 

^ 1. Cost per placement i^pdicates. how much it cost the prime 

sponso^ to put a CETA participant into a Job. • It is computed by dividinig 
the total accrued expenditures by the number of people entet'lng employment. 

2. Cost per indirect placement is computed by dividing to? -^1 
a^rued dxpendittires bys^he number of indirect placements. It indicates 
the cost for each personywho wad placed rfter receiving CETA services 
^ther than Assessment sad referral, ^ ' ^ ^ 

: \ ' . 

# 3. x <To&t per enrollee indicates how much It costs the prime 
sponsor to serve ^adh participant enrolled. It is comput^ by dividing 
'accrued expend iti ffig^ by number of entollees. 

t^ l^inmiary , tJ^^ 27 presents, a summary -picture of /performance by the 
32 Mime sponsorsrlnciuded In^thls study for each of the el^ht ind ieatoro - 
di^ussed .above. The figures reported are averages .for six quarters 
(12/74. 6/75, 12/75, 6/76, 9/76, and 12/76). The table shows thfe highest 
and lowest scores for our 32 sites as well as 'the averages for the 15 
national sltA s^parately^ Jthe 17 Ohio sites separately, the" 32 sites . 
coi^lne^, ^cl a^national' average. Except fgr nonpositive temSLnation, the 
naAonal sites performed better on tbe termination indicators than the 
national average. The Ohio sites performed less well than the'national 
average. The national si^s had costs higher than the national avei/age 
on ail three indicators. The Ohio sites had^psts Tiigher than the \ 
national, ayerage on two of the three cost Jndicators and their costs|were 
aWo higher than the national sites on those indicators-. J 

Disc^sion of Analysis Procedures 

Two general techniques were used^ cross tabulation and correlational 
analysis (Pearson *s r) . Crosstabulation was used to examine associations ' 
between the more qualitative explanatory factors and the performa^ice 
»me|^sures. Correlational analysis was used\to verify the resu^lts of 
the crosstabs and to examine the relationships between more quantitative 
explanatory factors and the performance measures* 

In generalT assdciatioiis^ were examined ror all 32 {irlme sponsors 
together in order to maximize the number of data ^po|.nts* and to increase the 
generalizablllty of the ^results . ^The same associations were also ch^A^d 
for both the national sites and the Ohio prime sponsors sj^parately. 
Where the patterns fpr the two groups- varied markedly, ouiKj^reference wks 
to rely on the results of the Ohio group, the rationale' be^Jig that the ^ ^ 
Ot\lo sites together are more representative of all prime apohsots In thfi ^ 
country than are the national Qitea. / ^ * • 

^ Crofi^s tabula t^on| was Oieed for afl of the qualitative factors and for^a 
few of the quantitative factors; Because the qualitative factors reflect 
'our assessments of the prime sponsor over time, it t^a^felt th^t a similar 
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"time-^cDinprehensive" Indlc: wlon^ of the perfocmeoce incaQures should be 
used In the crcjstTus, rather th^iu selecting just one quarter arbitrarily 
or repeating the cvccs tabs for evevy individual quarter. To obtain a 
representative Indication of performance on the performance measu^s, the- 
prime sponsors scores were averaged oyer time. /The six quarters* uded 
were indicated above. » ^ 

Once the averaged scores were obtained, a simple grouping technique 
was used. Prime sponsors were grouped on each of the explanatory factors' 
(for example, high conflict, medium conflict, and low conflict) and on 
Bach of the performance measures (higher than the- nationr.l -average and 
lower than the national average) . For each of the groupings on the 
explanatory factor, the proportion pf prime sponsors having higher 
performance was compared to the j)roportlon having lower performance. The 
resulting distributions wet*e examined to see if any associations were 
present, (It should be noted^hat the ninnber of prime sponsors with costs 
lower than the national average was too small to provide useful generali- 
zation^ For the three cost indicators, the sample average was used to 
provide a cutoff point, thus increasing the number of prime sponsors- in 
the lower cost groups.) 

Correlational analysis was used to verify th^ crosstabuLation results 
and to examine the^trength of the Relationships between the quantitative 
factors (participant characteristics, program expenditures, enrollments, 
unemployment rates) and the performance measures. All •quarters from 
'December, 1974, through December, 1976, were used in the correlational 
analysis. - • , 



EXPLAINING PRIME SPONSOR PERFORMANCE ON TITLE I 

Explanatory Factors Over Which the Staff Has Little or No Control 

Staff members are correct when they assert that they have little 
control over the unemployment rate in their area, the level of CETA ^undln^ 
they receive, the pre-CETA manpower experience 6f their staff, and the^ 
administrative integration between Title I and the PSE Titles. They^.are 
incorrect, however, if Xhey assert that these factors somehow detenn^.ne 
how theii* program performs or even set very tight limits on what can and 
c&nnot be achieved. ^ - * 

Unemployment Rate . The conventional wisdom among manpower -people 
suggests that performance suffers when unemployment Increases. Prime 
sponsorships with high unemployment are expected to have lower placement 
r)ates and probably also higher costs for placements and enrollmAts* 
However, the crosstab analys-is showed no relatlonshiiT'between level of 
unemplo3^^nt and placement rates, nonposifclve termihatlons , or cost 
measures . 

For each of the dependent variables, prime sponsors were sorted into 
6ne of four groups (1. unemployment (UE) lower than the national'^ average 
and dependent variable (DV) performance lower than the national average; 
2. UE lower than the national average and DV performance higher than tl^ 
national average; 3. UE equal to or higher than the national average and DV 
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perfonnance lower than the average; and 4) UE higher r.han the averag^and 
DV ^erf enhance higher than the average). The nuwber of pi.ime sponsorsS 
in each grcwp was e;<^»n>ined /or each separate dependent variable, but n^n*^ 
of the dictributioi r^-.vealed any pattern between unemployment and 
dependent variables, 'ilicre was % sizeable group of prime sponsors thati^ad 



both high unemployment and high placemejftts^ 



The results of the correlational analys^ls moderated the preceding coi 
elusions , only slightly. The correlations for all 32 prime spbn^ors tog^her'' 
showed that the assotiatioft. between unemployment rates and thei f our ^ . 
placement measures were' extremely weak. Although the dir'cction of 
the relationships was in the predicted direction (negative), the/'^gnitudes 
of the statistic were all very small (less than -.18 in every c^e) . . 
The associations, were slightly higher for the, Ohio group alon^(none wer6 
greater than, -.33), indicating that jinemployment had a somesmat mote 
deprjessing effect on p-lacements ' for the Ohio group than It'did for the 
TWttional group. What is striking is that the correlations between 
unemployment and the placement measures for all 3. groups of prime sponsors 
are so small. If unemployment rates w^re actually affecting placement 
in an important way, we would expect much larger correlations. 

- The effects of unemployment rate on nonpositive termination, rate' and 
the three cost Measures were again surprising because virtually -no relat.ioa^ 
ship existed for the national sites or the 32 combi*ned* The correlation's 
with nonpositive termination rate were all less thCan .1, and the correla- 
tions for the cost measures ranged between -.I'^nd .1. For the Ohio sites 
there was a slightly stronger relationship, but again, the magnitude 
was not large (none of. the correlations exceeded .3). 

To determine whether the low correlations between unemployment and the 
perfofmaace measures might be masking non-linear relationships among the 

- factors^ scatterplots for each relationship 'were examined for all 32^ 
sites together, for the national sites, and the Ohio sites. The results of 
tjiis analysis of 24 scatterplots did liot change the conclusion that ^ 

'unemployment had only a weak effect on the placement v^erformance of the 
.OJilo prime sponsors, and no relationship on the national site§. Inspection 
of the scatterplots revealed no nonlinear relationships, and the weak or ^ 
nonexistent ^linear relationships were visually reinforced. ' ^ ' 

That only weak an,d inconsistent, relationships ^ere discovered between, 
unemployment rate and program perfqrmance measures in the previous ^naly8es 
led us to^ examine the relationships, again, on this occasion controlling, 
for time. Correlations were^run for the individual quarters and the 
relationships between unemployment and performance measures were re-examined. 
The results of .this analysis are summatized in Table 28. * ^ 

This aji^proach revealed stronger relationships than had been observed 
when all quarters were merged, especially fdr th# Ohio prime sponsors. 
In general, both the Ohio and the. national prime sponsors' placement rates 
"were held dovn by increasing unemployment, when the correlations a;:e 
examined by quarter. Relationship's were the strongest and most consistent 
across placei^ent indicators for the national sites for the quarters ending 
in June and September, 1976. (Correlations ranged from ^.25 to -.50.> 
For the Ohio sites the strongest associations appeared in the** quarters 
ending in December, 1975, and June and September, 1976^ (Correlations 
^ tanged from -.27' to -.72.) These telatfonships i;ended to- wash out when 

r 
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lable 28:- C0'?J'vi:;LATI0N5 Bi;rkn-liN WlEHTLOYMEriT RATE FOUR PLACEblENT 
MEASURES. SEIECT'-D (JL'ARTERS, 1974-76, NATIONAL SITES, OHIO 
CITES, AND. 32 SIT^S COieiUED ' 
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£(11*32 prlmq sponsors were srouped together. And t'Viara w;re no consistemt 
rela^onnhlps found betnetMi unemployment rate and the c©st measures or - 
jionjjosltlve tcrninat^oi^ rate. ^ ^/ • "^t/t 

^ , There are'fiveral plausible, ^ot mutaally exclusive explanations for 
the lack of a coa9 latently strong relationship between unemployment 
and *perf gnuance . * Flrst^ althpugh It fs* harder to place people 'la quantity 
j-n periods. of rising unemployment It ^eems 4lkely that as sortie of the 
recently uneruployed (who already have skills and are riot *'hard core") becooe 
CETA clients they.may b4 relatively easier td ^lace as Individuals-given 
,both their s}cllls and proven record as workers. ^ 

Second, It Is conceivably Jijiat job developers working for the service 
deliverers (both In-house and/subcontractors) become more aggre'^sive- In a 
slack labor matket and thus pf fs§t the depressing effects of Increased 
unemploy^ej[it on placement.^ 

All of the mixed flhdlngs^ reported above on the relationship between 
unemployment a^n4jperf orrafeiQce suggest several gpneral statements. First, 
unemployment., certainly pjrovldes some constraints on what can be achieved. 
Second^ and mos^i Important, Xhose constraints are relatively weak. CETA 
staff do not live. In a universe tlgKtiy determined by the unemployment ra^te. 
Neither they nor the Department of Labor can accurately^ explain poor program 
performance by simply referring a hl-gh unemployment rate. Other factors 
.help explain poor performance. And, even In the face of high unemployment, • 
there 1^ much rtrat can be done by a staff f that can result in good - ^ 

performance . ^ . 

Funding Allocation Trend . The effect on program performance of change 
in the level of Title I funding over time was -also Investigated. ' Prlm^ 
sponsors were grouped into- those with static or shrinking resources ^/ 
between FY 74 arid FY. 77 and those with eX|)andlng budgets. A change of less 
than 107% (the national average) was used' as a cutting point ^to <l^termlne 
the groups. . ^ ' > / • 

Qjje might expect prime sponsors with shrinking bud^ts to be hav- 

In^mofie. difficulty li> their manjvower programs, and to dempnstrate p^oorer 
performance. The results of the crosstab ^na^^^Jk^^Jvowever ; sh(2^ed modest 
sugport for the opposite conclusion — prime sppnsors with losses tended 
to have better placements and Ipwer costs than prime sponsors with 
expanding budgets. .There was no **^»i^tlonsnlp with nonposltlve tejjpiination 
rate. Presumably this suggests that ^.tij?^ sponsors ^faclijg the difficulties 
of sftrfnking resources have been forced to back on nonessential ' 
services \thus lower costs) and on -service deL^^^©^^rs who wei* not 
performing well (thus better placements) . At least ^to^ the tfHort run • 
reduction of budget may Increase performance. The prc6le»^of course, is 
that continued reduced funding will ultimately mean* a reduc^^ in e^lther 
quality or quantity of service, or both. " ' 

>^ 

, Pre-CETA Staff Experience .' One might reasonably expect that prlme^ ^ 
.spQnsors in wttrlch a higher proportion of phe staff had been Involved in 
manpower prlof to CETA might have better lierf orrpance than prime sponsor^ 
in which the experience level was lower. However, thfe crosstab analysis 
for all 32 prime s^ronsprs together showed no patterns between experience 
and aqy of j:he performance measures- The correlational analysis did not 

■ ■■' • 101 
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change the coiuduclon. Lf^:? '^orrel ition coefficients Ij^'icated no relatio;*- 
ship ras prenen^ f .^f^tho Ohio prime sporsors, and only a oddest relationship 
was present for the national prime sponsprs. 

* * ' . * 

Ta±S lack of rilattOTisM:p"~suggestc that thje- experience' in CETA was 
really quite ^different than the experience with categorical programs jand 
that ever^ "it *on the staff had to leGm a great deal when CEJA came into . 
being^ regardless <5f vy'iether they had been involved with categorical 
programs or had just been hited. It is also quite possible that the 
manpower "professionals" from before CETA did not really have a broad 
enough experience, to develop skills that wbuld «erve to make them bol.tcr 
CETA managers than someone moving Into CETA from other -experience. Raw 
quaJjlty of staff seems likely to be much m0re important than experience ^ 
.that, in retrospect, was probably not directly relevant. 

• As CETA continues, of course, then one* might expect 6hat the ncfe 
experienced a staff is in CETA specifically the more likely it is that they " 
will be able to make management decisions that lead to good performance.' 
But thi^ hypothesis could not he tested in 1976jr77.' As pre-CETA manpower^ 
experience loses most of its somewhat questionable presumed relevance 
,in the next few, years then* research on the comparative performance gf 
prime sponsorships to determine the impact of the CETA experience of 
staff members would be appropriate. 

Administrative Inteferation for Titles I, II, and VI . Integration 
within the staff for adrainis^ring Titles I, II, and VI had little effect 
on performance. The cros^ tab ^analysis revealed no clear association 
between administrative integtation and the performance measures. The 
correlations revealed a mixed impact. There was S moderately strong 
relationship for the national sites between increasing^ administrative 
ita^egration and increasing costs (correlations jrere in the \3 to .Arrange 
for all indicators), but no association was present for the Ohio sites. 
Administrative integration was not related td any of-the placement measures 
for the national sites, bwt it was f^r the Ohio prime sponsors— as 
administrative integration increased, placement rates also- increased 
(correlations were at the .2 to .3 layel for three of the indicatcJrs) . 

Since administrative integration by itself appears to have no 
consistent impact on performance a more important question — that of 
programmatic integration allow^-ng^ participants^© mdve easily Ijptween 
titles — becomes centra!.' Our observations in the field lead us to believe 
that ^minis^rative integration promotes programmatic integration, ' and 

that the latter oiEfers the poterttia! cf improved service for parti^cipants 

f- - f . _ 

Explanatory Factors Over Which the S^aff Ha6 Some Control 

: ^ ^ ~ • V . 

Quality of Top Staff and All Staff . Both the crosstab and the 
corraL^ftional apalysis for alj 32 prime sponsors revealed clear associations 
between quality* of the tfop staff and the termination cluster indicatc^rs. 
Prime sponsors with top^staff^ fudged to be very good had higher plactoent 
rates and lower nonpositive termination rates than pirirae sponsors in vhich 
the staff was good or fair. There was ifo relationship' with the cost 
cluster in3iCj3tors, however. Thg^ same relationships were present between 
quality of all fltaff and the performance measures. The correlational 
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analysis gener??lly sui>ported thes^ conclusions, although the effect of • 
staff guallty (both quality of top staff land ef all §taff) wa§ more 
pronounced for the Ohio sites than for the national sitles. (CdrrelationD 
were in the .3 to .'4 range.) Again there was no relationship repealed 
•with' the cost maisur^s^ , ^ 

Although staff quality is a difficult factor to change, iC c^n be 
improved over time, and' a dirfettor interested in imprjpving program per^, ^ 
formance would do well to make the effort. Staff quality can be changed , 
through internal reorganisation, reassignment, job redefinition, in-house 
training, leave* forf upgrading assignments, personnel exchanges, turnover, 
attrition, and conscientious -recruitment of new' personnel. The results 
^ of our analysis suggest that the effort will be rewarded with better 
performance. \^ * 

e ' ' . * 

Location of Operating Responaibility . Although (jifferent prime' 
sponsors (In .the personal setose) rave different motivations for centralizing 
program operations directly with the'vCETA staff ^ (the'in-house ^|odei), 
one commonly cited reason for the inAiouse choice is t;hat it allows the 
staff to maximize control over, program operations and, by extension, to 
d© a bett% job. tTo shift responsibility for program operations from 
outside cpntractors to the CETA staff is a major change with serious ^ 
political implications, a change not to' be undertaken lightly. TJius it is 
/useful t6 explore the relat ionohip -bnetveen location of operating responsi- 
bility and program performance measures to see whether the change is , , 
warranted. The cross tab analysis showed no association between nature of 
operating responsibility and the termination ^cluster Indicators. There 
was some relationship with the cost indicators', however, the prime 
Sponsorships that ran programs themselves tended to h^ave higher costs 
than the prime sponsors who contracted out for services. > 

The results of the correlational analysis revealed .a clear impact of 
operating responsibility on program performance for the Ohio s^tes, although 
there was no pattern for the national sites. For the Ohl^ prime sponsors, 
as the prime spqnsors* operating responsibility iricreaaed <that is, as 
the degree of subcontracting decreased and the in-h»use responsibilities 
^ f or service delivery increased), placement rate^ tended^ to drop (correla- 
'/tions were in the -.3 range, for three of the placement measures), and 
costs^^r obtaining placements tended to increase (correlations wei^e in the 
.3 to 7^ range) . 

^ Many prime sponsor staffs feel it is too expensive politically to' 
change the existing structure of subcolntractors significantly. The 
results of this anal^is suggest that; it. is also likely to be more 
expensive fiscally, and that placement rates are likely to change for the 
worse if subcontractors are dropped in favor of in-house operation. It 
may, however, be worth political costs incurred to drop inefficient ^ 
subcontractors in favor of better subcontractor* 

Involvemerit of Business . The Department of Labor Tias generally 
^cdnfeidered the involvement of business in prime sponsors' rrfanpower programs 
to be desirable and has encou'rageil .prime sponsors to strengthen ties with 
business. In exploring the -relationships between b^jness involvement and 
the performance measures for the 15^ natioifial s^ites^ne Ohio sites were 
excluded because current data were n^t syllable) ,^^^ad found tl^t 
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business Involv. client' uss ncu reJat-cd directly to p^acc::icat rates or* 
nonpoGltive terminations. There wns a relationship between higher 
business Invplvoir n': c»,yl lov;Gr costs JFor placements and cnrollraeivts , howevri. 
The^cSults cI vho cc^^r-^lallonal analycis ConfiriLed these findings. • ^ 
(Correlations ^ jre in the -.2 to -,3 ra.nge.) This 'suggests that staff ' 
efforts to Involve business actively not 'result In additional slots 
for plao'?m-;r:t : in the short rui;j (as reflected in the statistical measures'* 
of placements used here), but lt.m:^y help to ^roduce-a cost-effectiveness 
mentality that results^ in more ,ef f itient use of CETA resources .^y ' . ' 

Involvement of Advisory Gouncll3\ Involvement of manpower advi oiJC, 
councils has also been stressed by the Department of .LK'ibor as a desirubl^, 
goal for pVlrae sponsors. We investigated the relationship ^betwe^n MAC 
activity and program' performance/ not expecting to find any relationship, 
The^ crosstab analysis showed^ however, that pr^me sponsors with councils* 
that, were active or active and jmf luantlal tended to haVe lower costs - 
for placement (fpr both l/dlcators), while prime sponsors who had MACs that 
wer^ neither active no^ Ipflueniclal tended to have higher costs for 
placements. No relationships w[ere found for any of the other performance 
measures. The correlational ai^alysls did not reveal any new relationships. 

While advocates of strong/ advl^ry -councils may be dlsappoipted that 
morie and Stronger relatiof^ships were not revealed, it should be stressed 
'that active councils serve matiy purposes at the local le^l other 

than impacting on program performance as measured here. We in no way 
\5ould suggest that the lack of strong. association with performance measures 
means that councils haye no beneficial effect on program performance 
and therefore should be, scrapped. We would argue that there are many 
observable positive values associated wi<h -a high degree of MAC activity. 
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Svstem-wlde Commitment to Placenynt . One might reasonably assume 
that placement performance would be better in areas in which there 16 a ^ 
widespread commitment to^ placement as a goal for Title shared by major i - 
groups of manpower jactote . -Generating such a systemr-wide commitment would 
be a major task for the staff, so the as^sumption was tested for the 15 
national sites tor which data were available. 'The crosstab analysis reveal- 
ed no relationships. The coi^relations clarified the effect somewhat, 
revealing a weak relationship between the presence of systeln-wide 
pDTrmitment to placement and placementr rates (3 of the A measures had 
correlations at the .2 level). One possible re^ison for the lack of a 
stronger relationship Ife tha$ in 3 of * the 6 sites that had a moderately 
high commitment, th\s commitment had emerged Only during FY 76 because of ^ 
changes in the staff leadership, and had'tiot had- sufficient time to filter 
down ,and show up* in the placement rates. 

Level of Conflict . The coraraonsense notion that performance is likely 
to suffer if conflict is too pervasive and intensive was also examined. 
Mixdd, fairly weak relationships were revealed by the analysis. The 
crosstab analysis showed that conflict was inversely related to placement 
performance — as conflict increa?3ed, performance r^te decreased. There 
was no relatldnshlp with nonposltlve termination rate, and the effect* on 
the cost- measure was unexpected-*-as conflict increased, costs decreased. 
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The resulr.s of the^correlatlonal analysis showcu t=hat level of confl^\- 
did not have any coijp'lstent effect on p)afe<enjent performance (theil^ was only 
a very weak asriOc5,atlon \;JLh two nier.surc^jl of placement for* only tl^e Ohio 
sites). The irN-iis : iciutiopr>hip with, costs fo^- obtaining placements and, 
cost per enrollc.5 *ar;)f aved again — as level 6f conflict increase^, thesje 
costs decreased in bc^ the Ohio* and the n^|:ional prliie sponsor groups. 

The explanation for t^he last relationship could be that since much 
conflict is- ^nerated by choice of service deliverers, a system with 
high conflict 'may be in that statue because one or more of the le^^st * 
efficient deliverers has beeq cut, either totally or in part. This rbould , 
mean that co^ts systemwide would decrease since the more efficient C'^li^^c^v- 
ers would te left Thus we do-not interpret the finding to suggest that ^ 
conf-lict* directly causes lower costs — rather ne think that the source of 
much confldct — reduction or eliij^nation 'Of weak deliverers — creates 
both conflict and lower costs simultaneously, y 

Qu^ity. of Program Evaluation . . Doing thorough evaluations is uiificult 
time-cbnsumlng, and entails political costs at the local levels For these 
reasons and many others, many prime sponsorships do tiot do program 
evaluations. Enough of our group of 32 did do good e\;aluatlons, however, 
to ai:|.dw hs to * investigate th^fcslink with pro-am performance. The results 
of the crossrab analysis revealed no relationships with- any of the perfor- 
mance measures . . 

•The correlational analysis revealed no association between quality of 
evaluation and any of the j>er forma nee measures for the national sites, but 
patterns ^fexe present for ^the Ohio prime sponsors. Specifically, as 
quality 'Of^ evaluation improved,, placement rates increased (cgrtelations 
were at the .3 level for three of the measures), and there also \ms a 
weak inverse rela^t ionship with the two cost of placement measures— as 
qoality of evaluations improved, the costs of obtaining placementaf 
.decreased (correlations wejce at the -.2 level) 4 

In part the lack of stronger findings may stem from the 4:elative 
Hiewness of program evaluations in areas in which they have been undertaken. 
It seemfe. reasonable -that it may take a year or two for t\\e use of evalua- 
tions to be reflected in subsequent program performance. 

Although we[ cannot at present poJ.nt to a strong link between' gqod 
evaluations and good program performance, itj should be underscored that 
evaluations x:an serve many purposes at the local level other -thah improving 
program performance on the statistical measures used here. We support 
the ide^a that pr'ime sponsor* staffs should develop and apply program , 
evaluations/within the cautions ^utlinexi in. our prdgress reports of January 
31, 1977 and April 30, 1977.. v - ^ ' 

Explanatory Factors Over Which the Staff Has Relativeljy Hifih Control 

* * ' ' ^ ' <^ 

Staff Commitment to Placemen t. We hypothesized ihat staff attitudes 

are an important factor affecting program performance. To test the 

hypothesis, We examined the link between the staff's articulated commitment 

to placement as a goal for Title I and the prime sj^sor's performance on 

the placement measures. For every indicator in the termination cluster, 



a clear pattern wac? cvltlrnt. In pj-lm^ cporcors in whl^h/rhe staff's 
commlC'insnt to placarrcny i/as high, performance on the placcaeut measures was 
also high. In airta'^ Ui which the staff commitmanD to placement was low, , 
placement perfftL-^aucc tended to be low. The effect ^carried over to 
nonpositive tariiiwaiLo citrates also — prJrne sponsors with ^high staff courinit- 
ment to placement tended to fiave low nonpositive termination rates. The 
correlatl'^rc rjenerally confirmed these relationships, although they, appeared 
only for the Ohio siteo. ^ * 

The <:oran»itm3nt to placement also carried over to perf ormcinrti r.s 
measured on the cost indicators. Prime sponsors with high commitiaeDC: to 
placement ha(} lower costs for both indicators of placement costs. 

Commitment to placement alone will not guarantee better placement 
rates, but it is an important first step for a staff to take because it 
leads, to other actions that will hel^ implement the commitment. 

^Quality of Program Monitoring . We would expect' tliat prim^ s^^oasors 
witlvhigh quality monitoring of manpower programs vould have better 
placement rates and lower costs. The expected relationships were only 
moderately supported bj^ our analysis. • 

The crosstab analysis showed that of the prime sponsors with limited 
monitoting, a majority had lowe^^acement rates ,^^as expected. But of the 
prime sponsdts where monitoring was good or very good, only half had higher 
placement rates, and the. other half had lowe^ placements . .There was no 
relationship between quality of monitoring and noripostliye- termiudkion 
.r^te. . . ^ ^ 

A moderately strong inverse relationship was present between the quali- 
ty of monitoring' and the costs per placement — prime sponsors with ICw 
quality monitoring had higher costs for placements (for bbth Indicators) 
and primes ^Ith good and high quality (monitoring had Ipwer costs for 
placemSits . * 

•TtT^^orrelational analysis shoj>B<d that the quality of monitoring was 
moderately related to increasing'^acement rates for the Ohio prime' 
sponsors (T:orrQ^tions w^re In the \2 to .3 range for all indj-catprs) , but 

*not for the national prime sponsors. No relationships emerged with 

. the cost measures. 

Program moni-toring is an important key to good performance;^ althpugh tl 
strength of the relationships reported here suggest that it is far f?fem ^ 
sufficient by itself. But in addition to ita, effect on program performance 
as measured here, it should be noted that good quality program monitoring 
will serve other important purposes at the local level. No prime sponsor 
staff le likely to exercise much* effective control of a manpower system 
without ^good monitoring. * ^ 

Participant Characteristics . Some clients are more difficult to serve 
and place, and this fact of life accounts for prime sponsors' creaming in 
intake and referral and placement. Many practitioners have suggested that 
flferving the hard core disadvantiged'cl^ient is incompatible with a streBs on 
placement and cost efficiency. ^ 

- . ' - ' * lOo.' ' , • ' 



This aaalysls ex-^mln.-^'? the association between Revels of scivlce to ' 
^severr.l client groups and pypgram perfomance to test the assui^ptlon that* 
cl£ent characteri.st;^cs do restrict prograta perfomahce. Six characteristics 
were clio'sen to ro^flcpt tha more dlf f lcult-to-s4wV^ enrollee: economically 
disadvantaged, welfare recipient, Je"ss th^h a hjgh' school -education, 
* unemployedjw f female, ^nd nonwhlte. Thte percetltrfgeg' of each group served ' 
1>etween )>*^r2T.ber, 19,7A, and DeC^nb^r, 1976,^ wer^ correlated with the ' 
felght program perfpnnance measurjes for all 32 prime sponsors and for the 
Ohio and national sites separatiely. In general,' we found no relationship 
between the typ.e^ of par'ticipanfs s^rye^ a|^d pyo^ram ^rformance mea^urfed 
with ojir term'inatipn and cost 'indicators .* Thfe' few exceptions to tai. f 
general conclusion are notec^ In the discussion below. 

With ^espept' to placement indicators, the percent economic'.dlly 
disadvantaged served and the percent with less than;.a hig|t*school education 
showed no association at all* for either the 32 prime spoinlbors together, 
the national slteS) or the Ohio sites. -The percent fismales served was 
^'not related to placement for either the'^ sitea or the Ohio sites. The 
' percent of 'u nemployed iserved had an iiiconslsteut' ef f ec^ on placement 
rate^dependirig on the measure considirred. kThe one pattern that emerged 
was that regardless of the grouping <rft 'prime^ponsors , the percent 
unemployed enrolled had a depressing effect on the indirect placement . 
rat^ and this effect was strongest for ^the Ohio group (the correlation 
statistic was in tjte -.5 range). The feffect of the percent of welfare 
recipients ienrolled was either nonexistent or in the opposite direction of 
what was expected. In the Ohio sites, .the percent of welfare recipients 
was positively assoQlated with placement > indicating tHat^^lacetnent rates 
incteased as the enrollmertts of w.e^fare recipients increase^ i *^ere Was 
no^elationshl'p between the percent of nonwhite3 enrolled and placen^ent 
rate^ for either the-32 sites together or the Ohio sites. (For the ' . 

natl^i^nal ^Ites there was a moderately strong association in the expected 
direct^ion for two placement measures (-.3 to "X level).) ... 

. . ' \ • ^ • • ' ' ' ; • 

TJ\ere*were no associations between client characteristic^ and nonposi- 
tive tehnination rates for eithfer the Ohio sites alone or the 32* prim6 
sponsorg grouped tt)g'ether. Thfere were a few weak relationships,' among the 
national sites for females, welfare recipients, and economically disadvan- 
taged, but tljese relationshi|56- were opposite «f what was expected — as the . 
percentage of females enrolled increased , for example, the nonppsitlve 
termination rate idgcreased. (The correlation coefficients werfe, howeyer/ 
only about -,.2.) * ' • ^ \ . , 

There was no association between levels of clients served and th,e 
»costs of placements and enrbllmcnts. The only relationships that ^mergled 
were for the Ohio sites, and those were in the opposite direction of what 
was expected. -As the percentage of . unemployed persons enrolled increased, 
the' costs .for placement decreased^ (The corrjelations were in the ••2 to 
-A range.)' ' , ' ^ ^ ' 

In summary, it is clear that client characteristics do not dictate - 
levels of performance on placement rates and cost indicators. The absenc6^ 
of relationships between clients generally regarded as difficult to serve* 
and thte performance measures is surprising; , anrd it indicates two things. 
First, a number of prime sponsors are able to serve vhigh Tevela of 



"difficult" cilonto as moisjced by tiie six charactiriotic? use^ here and • 
still ob.taln rciaf^vely hi^/a leveln of placement i^^es^^,,^^ costs, while 
other prime spon^ v;*^ wUh ioT^er levels o%"dif f i|i^^lf**'*crients have not \ 
been able to obtain ht^her placedient t^Ues and lo^r costs'/ . . 

Second-, the .^b's^nte of relationships doefe not mean that some clients • 
are not morr— difficult to.serve^than others.' It Is more likely an indica- 
tion that the, categories on the Quarterly Summary of Participant Chara9- 
teristics .'do not accurately fneasure \^o is and whx) is not difficult to 
serve. The mottvatit^n x)f the participant £s j^trltlcal to tlj^ p^irurt sponsor's 
ability to obtain placements' aujd the Q$PC doejB not measuie inotivatJrn. 
(See'Thurow, 1973, for an .argument including the, position- thal^"crxjaming" 
by motivation makes go6d econotidc/sense.) * But the fipdingS of this 
-analysis should encourage prime sponsors not to adopt an "either-or"^ 
attitude about 'service to the disadvantage^ vejsus good performance. They 
are not incompatible go^ls-^ . * . 

Expenditures ,for Pro^r'am Activities * The compardtlve utility and 
effects of training programs versus work experience programs' have been 
long dtscttS^^ by manpower professionals and academics . Work experience 
programs 'are iiot generally regarded by anyone, -as placement intensive, 
while classroom training and OJT impart sp'edific skills ^^that „presufiably 
enhance the placemejit potential, of participants,. Work experience is a 
re'lativ^y ^'chea^p", program— more *peopltf^' can be served in^ work experience 
for a given amount of mdney than be sierved in classroom training or OJT. 
Thus prime' sponsors with^ a large proportion ^f their Titl^ I expenditures 
going to work Experience coyld b^ expected to have lower placement rates, 
higher notipositive termination rates, and higher costs fcor placements, 
although the cost of serving each enrbllee would be lower. 

Prime sponsors, on the other hand, ^ that have a large proportion of 
their Title I expenditures directed at classroom training , or 0,11 would be 
expected to have higher placement rates and lower cost for placements • 



The expected i;eldtioiiships were generally confirmed by the result^ 
of correlational" analysis^ between program expenditures and performance 
measures. , \ ^ 1 ^^-^-^'^ 

: 1. Work Experience Expendituries . As the'pjrpportion of work 
experience expenditures increased, the level of placements went^ down (for 
all indicators except indirect placement rate). ^Correlations were 
relatively weak, at the -.27 level* This pattern was present among all 32 
prime sponsors together and for the Ohio sites. ^ 

There'was also a moderately strong relationship between the proportion 
ot.work experience expenditures and the measures of costs for placement. 
As the work experience commiitraent increased, so did the costs of placing ' 
'people. The re lation^^p occurred only for the Ohio sites, however 
(correlations w,ere If^j^he .3 to .4 rang^) . 

There was no association between the propSrtion of work experience 
expenditures and either tfie nonpositive termination rate or the cost per ^ 
enrollee for any of the groups of pfime sponsors. ^, • 
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2* PZLljiLl'*^r*;lI±i£*' Correlatlor.3 between percent of OJT 
expenditures end pJLaceiacnf. rates for the 32 pr^e sponsors showed a modest 
association to .25 range), indicating that "as expenditures^ for OJT 

Increased, tha pVid?CL-ui*it rates' also increasfed. Tn ere was nt) association . 
with, the indi':cv:t .placement rate. The relationship between OJT expen- 
ditures and placement rates for the Ohio sites was 'relatively .strong 
(.3$ to .A5 lange) re flex:tlng, their greater reliance on ,QJT| as the moans 
of obtaining placements. The n^tio*nal sites, however ^ did not reveal any 
asspcl^tioiTj^between OJT expenditures and placement performance. 

ere was only a weaK relationship between OJT expenc^ltures aru non- 



posi^HI terminations, and that was only for the Ohio\1|iJ^es— -a& expenditures 
for,ojT increased, nonpositive terminations^ decreased, as/ vould be expected. 
There was no relationship between proportion of OJT expenditures and' cost 
per enrollee. n * 

Increasing OJT expenditures were telated to* decreasing costs for 
placetaents for all three groups of prime sponsors (correlations' were in 
the-. 2 to - 13 range). . . ' ^ ^ 

3. Classroom training Expenditures ; The association between 
tl^ proportion of spending for classroom training and the performance ^ 
measures of placement were surprising. Basically no relationship wa^'*^ 
present for any of the thiJee groups of prime sponsors, This might be 
explained in two ways. 'Firsts some prime sponsors rely hea\rlly on OJT for 
placements antj so do not pay consistent and innovative attention to the 

lacement aspect of classrpcm training. Second, classroom training - * 
peclalti^s are often chosj^-^ the basis of a general notlon^hat there 
"a demand in^a given T?£cupatiQn. But that notion may not oe very 
^clflc, about how large or Continuing the^demand is. For example,' tliere 
may be a shortage of auto body specialists, but that shortage may be only 
20 people. [But a classroom training^enterprise — which often reflects major 
comiijitmenhs of resources and time — may produce ,80 people -trained^ in auto 
body work. And, or cojurse, not even the first 20 ont« the market will r 
get the Jobs they face competition from a large number of individuals 
who have never had contact with CETA. , ' 

TKere were no relationships found l^jetween classroom training spending 
and nonpositive termination rates for any of the three groups of prime* 
sponsors. 

The effect of classroom training spending on the cost measures vas 
opposite for the Ohio prime sponsors and the national prime sponsors. 
Among the Ohio prime sponsors there was a modest association 'between ^ 
increasing classroom training expenditures and decreasing costs for 
placements (-.23 to -.29 level), as we expected. But for the national 
sites, there was an equally strong association between increasing 
classroom training expenditures and Incre^ing costs for placements (.2 to 
.25 level). \ , . ^ 

4. Other expenditures . Tliere were no general patterns between 
expenditures for services and PSE and performance, and only a few isolated 
relationships were discovered. For the Ohio*Qites, Increslsing expenditures 
for BepH^ces Were moderately associated wijtn a lowered indirect placement 
r.ate,'^nd with a lowered ^rate of aB^p^^-'-ffir placements (correlations were 
the -.S range) . Z , ' . 
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Only one weak association was present betw'een the level of PSE 
expenditures and the performance measures.. For the Ohio sites, as tlve ' 
proportion of PSE spending increasyd, the indirect placement rate decreaoed 
(^.2 level)* Ihe. absence' of relatflonships Revealed by the correlational 
analysis is prob^tbly a factor of tjhe sinall number of cg^sea of PSE 
e3qp,e]|iditures . We do^not feel these findings significant enough to refute 
comrton senf?** nnd our observations that Title I PSE is not an efficient way 
to obtain placements or to keep costs down. 

Enrollments by Program Activity . The effects of enrolljaeats in 
different program aptivities were examined as a check against the results 
/)l the patterns found for program activity expenditures. The results of 
the correlations between enrollments and performance measures were " 
generally consistent with the results in the preceding section. 

1. OJT E^ro^lKnents . The strongest ass^ociations occurred between 
the proportion of persons enrolled in OJT arid the placement measures • 
As the proportion of OJT enrollees increased, placement increased .j' The 
pattern wa^ present in all 32 prime ^sponsors and was especially strong in 
the phj.0 sites (correlations were in the .2 db .6 range). The national 
site#' revealed the same relations,hips although not^/^s&trongly. as the 
Ohio sites. The pattern was present for every placemtent^ndicator examined. 



There watf no consistent association between the proportion of OJT . 
enrollees and the cost for obtaining'piacetBents. There was a weak relation- 
ship with 'cost per enrollee — as the proportion of OJT enrollees increkse*^^ 
the cost per enrollee overalJL-tended to increase (c'orrelatibn of .22j. 

2. Classroom Training Enrollments , The proportion of enrollees 
*in classroom training was not associated nltlu changes in placement rates for 

the Ohio sifes, although there was a weak relationship in the national 
sites (correlations 4^ere in the to ^3 range, but Only for two indicators) 

Classroom -training enrollments were associated with detreaslng costs 
for placements for £he Ohio &ites (-.24 level), but the opposite occurred, 
for the national sites — increasing .the classroom training enrollments tended 
to increase the costs for placements. 

"J- * ' . * 

3. Work Experieiigg- Enrollments , These had a weak depressing^ 
effect on placement rates ,iPlp20 to -.25 range), and a stronger effectjxW^ 
raising^ the cost per placements The higher the proportion of worW 
experience .enrollees, the higher: the costs of obtaining plac^|»fihts (.2 to 
,.4 range). This pattern was reflected in all groups of j^itfe sponsors, 
especially the Ohio sites. > ^ 

4. , PSE Enrollments . The relationship between the proportion of 
PSE enrollees and costs for placements supported common sense expectations — 
the greater the PSE enrollments, the 'higher the costs of obtaining place-* 
nipnts (cdrrelations in the .2 to .5 range). This^pattern was especially 
strong among the Ohio sites, given the somewhat higher Title I PSfi/ 
enrollments there. • , ' ^ 

? Discussion of Prime Sponsor Resource. Allocation aroop^ f rggram 
Activities . The cortelational analysis has confirmed m^ny expectations 
abQMt relationships between program activities and the relative payoff of 
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investing in different progia:n acti'.vitioc . (If we luJ €at*i by program we 
wotifd cxpeot> to fjnd even Klronge» evidence; we are necessarily^ drawing 
inferences from tSc da-a we could ""analj^ze .) OJT is clearly the most - 
cpst efficient "Inepuy obf^nxBg placamcnts, as measured both by 
Expenditures aticl cn:oliment§/', and work cnperiifence is' the least efficient 
means of- obtaining plai^tments . "*^'U8 a prime Wponsor wishing to increase* 
placeniept r?^2^ and Icwer costs^ for placementir#hould Invent in OJT and 
minimize work experl4#nce. *Claasroom training ^vestments 'aipe- more likely 
to lower cost for placements, but areJtiot asso^ated with increasing 
placement rates. ^ And ar\^ prime sjJonsor wishing to ^fvoid high costs for 
placements will keep PSE expenditures ,and enrollments to a minimum. 

The Indirect Effects of Unemployment Rate . . - 

In px^evious sections, the direct el^cW of unemployijMent. rate on prime 
s.ponsor performance were* examined, and wejre cpticlud,$d.to.bfe iiot coo 
important/. Inr this sect»i6n, the indirect effects of unemployment are 
considered, by re-examining a \iuttber of the\ relationships while controllliig 
for the level of unemployment'. level* of 6% unetnploynient was used as a 
cutting point. Tlie unemployment rate*6f '^ac|| prime sponsor f* each 
quarter except September, 1974, was compared to'thp cutting point, and the 
cases were grouped inlTo low (less than>6Z)'ahd hy/h * (equdl * to \l greater 
than 6%) unemployment • Then tor. both the low and thffe high groups, the 
propcifti^n of expenditures and enrollments fpr different program activities 
and the proportion of patticiparft^ diaracteri&ticd wetre correlated with the 
performance measure^. • the correlations of the twt) groujjs wepe compared tt) , 
determine whefher unempLf^yillent had an indirect effect on these relationships. 
The results of tljis a^wflysis are discussed bflow. The^ most important 
results are pre6ent^ in Table 29. • 

Expenditures^BQd Enrollments for Program Activities . Vrfien unemploym^t. 
was low, the nationad^>l^es were abler Ibo^J^irtik classroom training expendi- 
ti^s with increasing plac^n^t rates, especially for two. measures — place- 
ment rate -and indirect placemeTJ^s^ate (coi^elations were In the .6 to .8 
range) . The national sites also stwij^d an e<^ually strong relationship 
^between th6 proportion of classroom. «u4Tiin|g enrollmcrtts and increasing 
placement, rates for the same tw^*measur6s^:^ut not for -the other two 
measures, of placement). The national sites^s^evealed no relationships 
between *e;lther ctSs^oom ttaining expenditures enrollments and the 
cost per placement me^ures when unempigyment was low, but thej^waS a 
strong positive relationship with cost per enrollee^ (correlations were .7 
an4 ^9). ' \ - ; • 

The Ohio 3ite5 did not repeat any o^^ these patterns, however, Even_ 
when unemployment was loiw, the Ohio prime sponsors were not able to link 
increasing allocations to classroom training (either expenditures or \ ^ 
enrollments) to increa&ing placement rates . Noi; was ^there any relationshitp 
•With* costs per placements, cost per enrollee, or nonpoaitlve termitnation 
rate . ^ / » • • ^ 

the two groups of prime sponsdrs behaved differently when the relation* 
ships of OJT allocations to performance measures under conditj.ons of low 
unemployment were examined. The Ohio sites were able to tie increasing * 
proportions of expenditures for* OJT to liigher placement rates (correlations 
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T'-Me 2?: ' c:!isFL/iiic>:s rr7,;LZ:-: sELi:cl£D^?:.aGil^J^'ACTIVIl7,^IZASu^J:;. ;u:d four flacemsnt measures,, 

BY LEVEL OF Ul^EMPLOYm^T, NATIONVJ. SITES-AND OHIO SITES, 1974-1976 ^ 



National 

Prine 

Sponiic^rs 



Ohio 



% /Class room 
vTralning . 
Expenditures 

% Classroom 
Training 
Enrollees 

% OJT, ^ 

Expenditures 

% OJT 

Enrollees 



% Classroom 
\Training 
\xpenditur*es 

% ClassrooiB 
Training 
EnrolWfes 

% CJT 

Lxpenditures 

% OJT 

Enrollees 



Low Unemployment ' 
(less than 6%) 



Placement 
Efficiency 



.25 



-.27 



.52 



.69 



Placement 
Rate 



.63 



.55 



.63 
.85 



Indirect 
Placement 
Rate 



.79 



.79 



.32 



Entered" 
Employuant 



.22 



-.25 



-.22 



.66 



.69 



High Unemployment 
(6% or above) 



Placement 
Efficiency 



.26 



.27 



Placement 
" Rate 



.21 



.22 



.-41 



ladirect 
Placement 
iXate 



.36 



.35 



.24 



* = ^iC-cletic". l-sfr than 1 .2 



ERIC 



112 



Entered — , 
Employment 
Rate 



.33^ , 
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wert In the ,5 to ,7 rtmpj for throe measure-^). Slr.^]r-rly there was a 
stron£^ acsoclntJoa among tpo Ohio sites between an incieooitig proportion 
^df OJT enrollee?; f^vA Incroa^ing placiimcnt rates (correlations were In th^ • 
• 7 to ,9 range i-^t^3 5ndicatnis of placrjLients) . Iherc was also a strong 
relationship bctzvcen OJT allocations and cost pe^i; ^niollee for the Ohio 
prime sponsors, (covrelations of ,6 and ,8) • 

natio n al sites , hc3wever, were not able to tie OJT commitments to 
higher placement rates when unemployment was low. There was a moderately 
strong relationship with a decreasing cost per enrollee as OJT cocnflJ.Cments 
increased, whi*ch.was opposite of what Was found for the Ohio sitss. 

The relationships that existed between classroom training and JOJ» 
commitments and the performance measures when unemployment vas low V^^^^^ ^ 
or disappear when unemployment is higher,^ Relationships ^between ^^.^^ 
proportions of enro^llees in classroom training and OJT and the perfbrmanbe^ 
measures were more resistant to 'the effects of high unemployment than were 
the relationships between expefiditurea for clia^sroqpi training and QJT and 
the performance measures.^ / ^ 

When unemployment is high, the 'natl<^nal sites did not demonst/'ate a 
relationship between classroom trainipg "expenditures and any of the , 
placement measures , and there was only a modest association between the , 

^^'proportion of .classroom training enirollees and two placement measures (.2 
qnd .4 levQl).'"The Ohio sitts continued t a show , no relationship between . 
classroom training .comjuitmrent an^ placement!! under conditions of high 

• uifa^pploymenL.* 

The link between •OJT and placement pbservei for the Ohio site^ with 
low unemployment was also weakened. There Oas almost no tie between 
proportion of OJT expenditures and placement (only one weak correlation 
with one i#ac^ent indicator).* There were .consistent associations between • 
the proportion rff OJT enrollees and all p'lacem^nt measures (.2 to .4 range), # 
although the rel^tlonshJ|>s were substantially weaker than had occurred 
with low unempl^jjj^ent . 

The Indirect ifffect of ^unemployment on the relationships between 
work 'experience cona^ttnents* and performance measures was not clear cut.^ r: 
The only generali^able f IndCri^^^a^t emerged was that under conditions Of lov; 
unemployment^ there was no relationship between the proportion of work 
experience enrollees and the three measures of cofl^s, but when unemployment 
was high, there was a moderately strong, positive relationship with all 
three cost measures for -both the Ohio and the national prime sponsor groups 
(correlations were in the .2 to .7 range). 

^ Few relationships emerged betw^een jyfinje sponsors* Title I PSE 

• allocations and program performance fee^rdless of the level /of unemployment. 
The one finding th,at did emerge was that when unemployment ywas low, ^ 
Increasing proportions of PSE expenditures and ♦enrolhnents were very^ 

* strongly telated to decreasing placement rates (correlations ranged up to 
.9) , ^increasing nohpositlve termination rates and increasing costs 
per placeroefiits (.91 and .96). All 6f^ this is perhaps what one would 
expect of Title H?^SE, but all of these relationships disappeared when 
ur^emp^loyment was high. The oHio sites imitated tione of these patterns. 
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The only association tliat e merged for the 'Chio "slLes p moderately 
strong relationship fcetv.^en the .proportion of PSE enrollee^ and the 3 
cost measures (.2 tr« .3 range), again different^ from the national sites. 
One |5ossible coticltii:lon to be drawn from these relationships is that wh6n 
junemployment i^ Jow, prime sponsor^ make little attempt to obtain place'* 
ments froift PSE, but when the unemployment rate gets hl;gher, prime 
sponsors beccne more placement' conscious with Title I PSE. * 

The results of a partly correlational analysis supported these i ' 
findings. Partial correlations between the proportion of program activity 
expenditures and enifollments and the performance measures were e^arairsd 
after controlling statistically for unemployment rate. The partial. corre- 
lations showed that the proportion of OJT enrollments was strongly related 
to incteasing placement rates for the oflio sites (parrtial correlations 
were in the .2 to .6 range for all measures). The proportion of classroom 
training enrollees was moderately related to' increasing plac^ent for the 
nati-onal sites .(partial correlations were In the .3 to ,»5 range) y Work 
experience enrollments ^wercd^ related to Increasing costs for piayfenents 
for th\ Ohio sites_(.2 to .4 level for both measures), and an ^creasing 
proportion oi work experience expenditures was weakly related to decreasing 
placement rates for the n^lonal sites (partial correlations, were at, the 
-.2 level for. all measures)>* . ' 

Overall, judging from this examination of the indirect effects of / 
unemployiifen t on progrdfm performance, it is clear that the ©ost noticeable ^ 
indirect impact occurs on the relationships between prime sponsor 
commitments to classroom training and OJT and performance measures. When * 
unemployment is low* classroom trainiiig and OJT are more likely to be strqpg- 
iy linked to increasing placements, but when unemployment is-high, these 
links weaken or evaporate^ Tl^us our ^arlie'r*conclusioi;Ls about the relatively 
weak constraints put on performance by unemployment continue to be valid, 
at least for a short-range future that seems likely to hold continued 
relatiV|ply high unemployment 'in it , ' ' 

Qiaracteristlcs of Participants Enrolled . The correlations between 
six characteris ticis of particip^ants and t^ie performance measuores under the 
tvo different unemployment conditions revealed no systematic patterns for 
Either- the Ohio sites or the national prime sponsor group,^^ Few relation- 
ships between participant characteristics axii program performance measures' . 
emerged at all, and those were only of tnoderate. strength, and only under 
conditions of relatively high unemployments >^ There was a weak inverse 
relationship fcetw^en the percent of economically disadvantaged enrolled and ' 
the three cost measures C-*3 level), ' Ab the proportion of economically 
disadvantage^d increased, cost efficiency Improved. 

For the national sites, there was an Inverse ^relationship between the 
percent of nonwhites enrolled and the three cost measures (~ .i' tib -.S^evel). 
In the national sit,es,' as the proportion of nonwhites increased, the 
placement rates tended to decrease, although this was ^ only a moderately 
strong relationship (-.3 to -.4 level). The Ohio sites did not demonstrate 
this pattern. ^ ^ 

The results of a partial correlation analysis supported these findings. 
Palatial correlation between participant characteristics and performance 
measures while coiAyolling statistically for the effect of unemployiaent rate 



confirmed again that parricii^ant rharacterlsf ig:s wgio. net rrlat^^t) any 
of the perfprir.auce mcasuren in a sy$vt^aetic way. The relationship that 
was observed was that the n'ational sites tended not to be able to serve 
d'high proportions ponvhit<*s and still- maintain high placement t^tes — 
there was a iroderatcly strong inverse relationship, between the percent - » 
nonwhites and* all of the placement measure^ (partial' correlations *^were in 
the -.2 ro range) , but again the Ohio sites did not reveaf this pattern. 

From this test of the indire^ct effects of level of* unemployment, we^ 
would conclude ^that the earlier contlusion that unemployment rate basically 
does not affect the nature of the participants $Hrved is still an a': .urate 
statenient. No systematic relationships .emerged, even when controlling for 
the indirect effect of xinemploymentT 

Summary ^ - • \ ' * 

Table 30 summarizes Jthose management factors we found to be telatiVel:' 
highly related to good perfonnance (defined as high placenent, low 
nonpositive termination, and low cost). Very weak relationships, have been ^ 
eliminated from this summary table. Those with a retation^hip only with 
costs but no relationship with either placement_or nonpositive termination 
have also been eliminated. And the two f^ictbrs (level of conflict and 
integration of Title administration) that pushed in differAit directions 
for different indicators *have been, eliminated . 

,^ the factors that were found not to have any rel%ti6nship to 
performa^ice are also important. Critically, none of those factors over 
V7hich the staff has the least influence were found to be c<5hsistently 
highly related to perfdrmarice . Even* unemplojnnent had Only a Modest 
impact. |Thus local CETA staffs are not facing a situation over which they 
can fairw claim to have little or no control. Equally important, th^ 
nature o^^he participants serVed in terms of aggregate demographic and 
economic categories, does not have much impact on performance. This means 
th^t the hard-core^ most disadvantaged panjt of the CETA eligible population 
can be served without sacrificing good plac^ent and cost performance. 

The table suggests that good performance on placement and costs are 
linked (that is only in pa^t because of the indicatprs we chose to use; , 
see Appendix B for evidence that the indicators are all measuring genuinely 
different aspects of performance). It also suggests that the nonpositive 
termination rate may not be highly "Susceptible to improvement by the ^ 
manipulation of the management factors we have analyzed. That rate^ may be 
much more a functibn of motivational dispositions on. the part of individual 
participants and the skill of a counselling and assessment staff in Working* 
with individuals. ^ 



EXPLAINING PRIME SPONSOR PERFORMANCE ON TITLES II AT^D VI • ^ 

Six of the measures used for assessing Title I performance were also 
used for assessing Titles II arid VI performance: placement efficiency^ 
CETA placement rate-, entered employment rate, ^ cost per placement, cost 
per Indiregt placement, and cost per enrollee. Given the movement. of 
indiv;tduals between Titles^II and VI in 1976 we f^lt it most reasonable 
to combine data on the two PSE titles for^analysis. 
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Tab-le 30: SUMMARY OF ASSOCIATIONS BpWEEK MATJAGEMENT FACTORS AND GOOD PROGRAM PERFOF^CE 



Presence of Association with Good Perfomance on: 



IIi£h quality staff, (both top staff and all staff) 
High degres of subcontracting for service delivery 

0 

High iitaff cquultment to placement* as a goal 

' . f ^ 

High qL'.clity of program monlttrf^ng 
.Relatively high level of OJT expenditures^ 
Relatively low level of work cxperieiix:e expenditures- 
Re^laj^ivply high enrollments in GJT ^ 
^Wtlvely low e!\raH«eff ts'ln wprk experience 



Placemgnt 
yes 
yes 
yes 

yes (weak) 

yes 

yes 

yes 

yes ' 



Nnn-positive 
Termination 

yes 

fto 
yes 

no 

^yes' (weak) 
no 
no 
no 



Cost 



no^ 



.yes 
yes 
yes 

* yes 
yes 

' no 
yes 
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Table 31 fn'^sents a sti^^jaary p'.ctur^? of FSE pirfciTnance on these 
indicators, Tlie ^i^res ar-a for June, 3976 • We realise, of course, that 
placennent Is not tbo tot^l goal of Titles II, and VI. and that these figures 
should not b« compared directly with those for Title I (see Table 27 above),' 

On all but one of the measures (entered etnploymeift) the 15 national 
sites were performing somewhat better than the Ohio sites. ' Both groups of ' 
sites performed better than the national average on the placement indicators 
' altljoufeh both were more costly than the national averages except in the' ^ 
case of the national site cost per indirect placement. . y . 

We ^.nvestigated the impact of seven factors on PSE performance: fiscax 
condition of the prime sponsorship, staff commitment to placement as a PSE 
^oal, the relative size of the' PSE allocation, economic conditions and 
demographic characteristics of participants, quality of staf;f (both' top 
staff and all staff), level Of conflict, an (4 level of*" administrative 
integratlpn' between PSE and Title I. The last three Had no consistent . 
and- strong Impact. The *f irst four did have some iiripo^tant relationships-, 
hqwever, and we will report on those ^ _ 

Fisc^ Condltij:a ^ • ^ ^ ' * 

We judged the fiscal condition of our sites on the basis of presence 
or absence of layoffs of government employees, hiring freezes, cutbacks in 
^ local services, and budget deficits. Primes without any of these prx>blems 
were judged to be in-good fiscal condition, those with all of them were 
judged to be In poor condition. Those with some but not all of the 
problems were placed in a mbderate category. We related this judgment to * 
PSE performance for the final quarter of FY 76 (June, 1976). 

We found that when the fiscal condition of a prime is poor, placement 
'performance buffers and cost^ rise* This was the expected pattern. Since 
most PSE slots go to local government agencies it is reasonable to expect 
low placements when those agencies are in a fiscal crunch. This finding 
held for all 32 sitefi| both aggregated and separated into the 15 and the 17. 

Staff Commitment to /Placement as a PSE Goal 

— [ 

We judged, the commitment of the prime sponsor staffs to placement as 
a PSE goal on the basis of our field work. We ranked the relative commit- 
ment in each prime on a four point scale. Twenty of the 32^?taffs we 
interviewed had little or no commitment to placement* Nine had a mild 
commitment. Only £hree had a strong or vqry strong comnitment . Cros^-* 
tabulations support the proposition that as the stdff cotmnitment to 
' ipLacement Increases so do the thtee measures of placement activity we used* 
yr Del^pite other constraints, commitment can make a difference. 

Relative Size of PSE A lloc atio ns 

\ ^ . . \ 

We calculated the size of the. PSE programs in relation to total CETA 
allocations for each prime sponsorship (excluding Title II summer money)^ 
In general, those primes with the largest percentage of alf their CETA money 
in Titles II and VI also did least well in. terms of their PSE ^ placements . 
Larger relative PSE programs made for fewer placements -In a relative sense. 
The larger programs also had higher costs per placement.. 
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TabW 31 


: * SUMMARY OF 


V 

PSE^RFCi^MANCE, 


NATIONAL SITES, OHIO 


• 

t 

SITES," NATIONAL AVERAGE, JUNE, 


* 

1976 






✓ 






• 




' V 

f 


Placeciarit 
Eff iciancy 


pETA 
Placemetit;^ 

..Rate V, 


Entered 
Ercplpyment 
Rate 


Co^t Per - 

Placement 

—r 


Cost per 
Indirtct ^ 
Placement 


Cost Per 
Erfrol lee 


lUc'i^st Score 
fcr 32 Sites 


26 


19 ■ 


74 


$lr67,250 

7 


$254,857 


6,646 


Lov3st Score 
for 32 Sites 


' 3 


2 


' - 7 


12,412 


/ 

. 21,683 


2,380 ^- 


/ Aa?erag2 *f or 15 
.^'/ National Sites 


- 14 , 


10 


27 


36,000 


55,000'^ - 


,.'^3,824' 


/- ■ 

^ ^ Average for 17 ' 
Ohio Sites , 


12 


. 7 


' 28 


y ■ ■ ■■ 

42,000 ' 


75 ,000 


X,104" '. 


Average for 
32 Sites 


13 


8 


27 


39,000 


, 66,000 


/ 

3,973 ^ . 


Naticria?. 
■ • Average 


7 


i' . 


24' 


32,153 


56,886 


' f ' ■ • 

/ 2,169 

; 


-J 






* 
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lEconomlc Cgrtxlltl ons and TvNn'> ^;rapb 1 c Charact erlstlcsjc^ Par ticipants 

^IJe used uue^fl'^yrr/: nt rate to loeasure economic condition and four 
participant chan'.ctrjTi'tstics: percent disadvantaged, on >relfare, nonwhlte, 
and high 8chgoi.graduat.es. 

Fof pIX "2 prime sponsorships considered together the characteristics 
pf participants enrolled in PSf^ programs^ are not related to any of the 
placement and cost measures. All correla> -ons are less than •2, Vepy 
low placement rates from PSE cannot accurately be attributed to the nature 
pf th|^ clients served. * . * * ^ 

Unemployment shows only^ a vjeak relationship with two of the placement 
measures—placement efficiency <--.24) and CETA placement rate (-.27). the 
direction of the* relationship was expected./ But it is a^ v^eak relationship 
and shows no relationship to any, of the other four performance measures. 
'Iflien the same relationships are In&pected for the national and Ohio sites 
s^p^rately the same filings emer^. Only relatively wealj; relationships 
wlt^ two of the placement measures emerge as having a^y particular impor- 
tance (-.30 and - .32 for the national sites and-^39 and -.25 f or. the 
Ohio sites) Ivnportantly , participant charact^flstfics still have no 
explanatory power. . ^ , , * " 

Summary • • - 

^ To the extent that placement is a gdal, of PSE programs, it Is fostered 
by relatively strong fiscal conditions in a pripie sponsorship, a relatively 
smaller proportion of all CETA money in PSE, a relatively low unemjUoyment 
rate, and a high staff commitment; to pla'cement. ^TKeflprt threfe- factors 
are riSt /under staff control. But the ^mt^tii Is an^^s bfeen shown to 
make a difference. Furthermore, the Hiree'^ "non-manipulabl^e". conditions 
faced by staft do not absolutely dfe tannine performance outcomes. The 
constraints are severe but /there is usually sfCill some room for manuever 
vithin l^>os€i constraints for staffs, coipmitt/cl to using PSE in part for 
placement purposes. An^", staff cannot cla^im that "they will lower whatever 
placement potential they have by serving people who have characteristics 
ysually, associate wl±h plac^)61\t^ difficulty ♦ . " 
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• V": COnCLUSIOlISij^ ibXNAGEIlENT AND GOAL ACHIEVE^E^ST 

• /;■ • ' ^ 

The CETA Gystcm Is^a rfelatlvely new but highly complex one in which the 
conception ef vhat Consttfetftfes good perf cfrmance is itself the subject 
of continuirtfi^egitima^e/disagreement and debate and in which actions 
taken often mainly indirect effects on desired performance, as well as 

some direct effects. Tb.prpduce meaningful an^ useful empirically 
grounded findings about |\thi§ system, we developed and employ v^d a corip.lo:< 
research design that hassled us to address many different factors with 
many different analytical); techniques and f ranieworl^^ . No simple desjLgn 
would bfe likely* to h^ve niuch pot;ential payoff. ^ - 

'.•te are uilder no illusion that we have discovered ''eveVy thing there J.s 
to discover about the relationships between (TeTA program management and 
high quality program performance*. We are certainly under no illusion that 
the set of research problems with which -we have been working for close i 
to three years is a simple one. 

There is, we bellf\{e, no magic key to producing CETA success. Hor, 
In fact, is there a simple definition of "success" In the CETA settiqg. 
Ue have been working witb^ multi-f afceted conception of ^success and continue 
to believe that such a conception m^kes sense. 

/ 

We have conducted our research on CETA management and goal p'^rf ormarfce 
with three broad aspects of supcess in mind (th'ese are adapted from 
Fried, 1976): • • ' 

. * * ' * 

1. Effectiveness In ten^s of goal achievement. 

2. Responsiveness in terms^'of the congruence of the cqnterils of goals ^ 
aotually heinfr pursued in programs with the content favored by Individuals,^ 
groups, and .organizations to Whom' the loc^l program organization^re j 
respoJ^|Jble*fn a formal sense. .(This Is a very large and diverse group in^ 
the case of CETA: Congress, the Department of Labor, local of f iclals, ajyr 
the local citizenry.) ... ^ 

3. Qfenness in terms of ease «f access and scope of access 'for those 
individuals, groups, and organizations with interests at st^H^to the proc- 
esses used for reaching a number of the decisions about how to maximize • 
both responsiveness and effectiveness. ^ , , , / 

This concluding section contains three major parts: 1)^8 presentation 
of explanatory model that is empirically supported- by our findings; 
2) a short? summary of. the principal, obMrvecl relationships; and. 3) recom- 
mendations based oit our findings. . 
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AN EXPLANATORY MODEL * ' . • 

VJe began our^rcsnarch with a very simple yodel that linked external 
local condition:?, local management decisions, and prime sponsor performfi^tice 
(see Figure 1 on pa.^e 2). Ue supplement ed this simple model with an 
empirically supported mcdel^f CETA implementation features based on our 
earlier study of all Ohio prime sponsorships • (Ripley and others, 1977;56). 
This model linked a nlimber of feature3 of local environmental constraints; 
local economic conditions; national policy and f^eglonal office activity; 
"local decisionmaking Influence p;\tterns; individual actor perceptions, 
attitudes, and preferencefet program decisions; and ^patterns of clienw , 
service with each oth^fer. . * - 

We are now in a position to elaborate Figuje 1 on the basis of" 
firi^iings thart have received strong support from the variety of analyses - 
we hav§ undertaken djiring the lite of the present project. Figure 3 
firesent^ a relatively detailed model of the relationships that best pxplain 
the ilature of participants served and program performance for Title I at 
the prime sponsorship level. ^ 

' The broadert conclusion from this study, underscored by Figure 3, is 
that CETA at tlie local level is not a highly constrained system. Local ^ 
decision-makers, particularly very , competent and ^committed local profession- 
al staff members, have a great dfeal of latitude to choose ^different options 
as they design delivery .system? . They also have a great deal of influence 
in determining who ^ets served and how well^ the programs perform. ^ 



In addition to the strong relationships that are portrayed in Figure 3 
(which will be summarized below* after the presentation gf a simplified 
model) both the weak relationships and missing relationships are also 
exy-emely important because they make clear the latitude' open to local 
decisioh-Tnakers. Unemployment as a measure of local economic conditions 
has been fotind to have -Sortie shap,ing effect on local preferences, on program 
mix, on the nature pf cWents served, and on the performance of programs.' 
But in no cases is the relationship deterministic, or even overwhelmingly 
strong. Tlie unejitployment situation^*provides a mild, to moderate consmlnt 
tliat certainly must be taken into accoutit by decision-makers, but the mild 
constraints introduced by the unemployment situation ^cto not alter the 
basic fact that those decision-makers still haVe a wl4e variety of different 
options in designing and operating their; programs. . . , 

Th^ history of local employment and training pr^rams in pre-CETA days 
has certainly helped shape some linger inng manpower preferences, some 
features of the manp6wer system (such as the identity of service deliverers) 
and soT?le features'of program mix (tied to the identity of service deliver- 
ers7,, but the impact of that pre-CETA "history is fading. The three years 
since the beginning of CETA at the local'^evel have, "even in many instances 
in #hich there was a relatively well-developed ^manpower delivery system 
fou^caC^gotical programs, witnessed a great deal of conscious, planned* 
change. And, 'of cotirse, there are a number of prime sponsorships in the 
nation that did not have muQh manpower activity ^at all before CETA. In 
those cases even the weak constraints of pi(e-CETA conditions are not present 
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n^r.;: 3: E>TXJIICA1XY SUPrORIllDT^tODEL or I^XUTICKSHIPS EXPUIKXKG nature of PARIipjtl%TS 

SERVED AhD PROGRAM PERFORitAKCE FOR TITLE I OF CETA- IN PPJME SPCKSORSUIPS^ * ^ 
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V 



Local Ecor.onlc 

Conditions 
(unecployrocnt) 



/I 
( 



Preferences, Priori- 
ties, and Coimitncnts 
of Influential Actors 



Characteristics 
of Participants 
Served 







History of Local 




Eicployitent & 




Training Programs 










Prograzi Kix 




(proportions of 


class- 


r£>on training. 


OJT, 


Work experience. 


P£E) 





lecal ^crar^-^nt rcrjsicr.s i'bcut Harpovcr Systeo ^ 



1. Quality of Staff 

2. ''^Quality of Data for ISecisjtions , 
"ii Quality of hicnitorinf/Evaluation 
4. Degree of. ^subcontracting 
5: Kode of Service Deliverer Selection 

6. Openness* of Decision Systefi 

7. >:anageir^nt of Conflict 



KEY 
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Strong Rcl^etlonshipsf 
Mildly^ Ccns training Relationships 
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.Two relationships that are pilsslng altogether from Figured ar€ also 
of vital importance. These are relationchlps for which we tested but were 
found not to bo .ln;prri,jnt* The first of .these Itiportant rton-existent ^ 
relationships is the fact that t|e demographic makeup of €L community does 
not detennlne chc nature of thos^ whom the ^rime sponsorship chooses to 
serve. (There are, of course, a few commonsense llmttts to tlfts assertion: 
a conmunlty compleflely devoid of Spanish^ peaking citizens, for example, 
obviously could nod service Spanish-speaking citlzensl) Given that the 
dollar resources allocated to prime sponsorships will npt allow all of the 
Eligible population\o be served^ the la^ge elenjprft of delib'irate choice 
-afforded pi;^lme sponsorships becomes even more apparent and more important. 

» » ^ 

The sebond important missing relationship "is tl^e lack of impact "of fte 
fgo^^B^te nature of participants served on program performance. Programs 
can perform just as well on the measures we used when they concentrate 
on the^relatlvely most disadvantaged part of tl^ eligible" population as 
when they gravitate towarcl the relatively least disadvantaged, who are 
presumably "easier" to serve. « We think the "easier "to serve/harder to 
serve" distinction that appears bo^h in some of the manpoweiSJlterature - 
and certainly in the rhetoric of some manpower practitioners l\ of used 
very loosely and as an illegitimate excuse for poor per foroanccl. ' 

We do not deny that some pfeople are likely to be easier to serve 
than 'others^ but we have found no support for, the notion that the^ Jevel of- 
difficulty cai^ be measured by aggregate demographic characteristics; 
Personal characteristics such motivation are, no doub>t, important. Ot;her - 
attributes, such as^ minority sfedtus, might be important in a community in 
which all pDtent^aJL employer^^dlscrlmlnated heavily against minorities. 
But the undenl^^le fact reiialns that' some primes liave chosen to serve the 
most disadvantaged (as measured by features such as ^ex, ethnicity, ' 
efconomlc status, welfare status, and education level)" and have performed 
' vfery v/ell. Others have chosen to serve more of the relatively less 
disadvantaged and have not done particularly well with their programs. 

One entire set pf relationships missing from Figure* 3 c0uld also 

have considerable importance. This is the absence of any^^Consistent; 

major Impact of activities of the regional offices of DpL. In part this 

is be(;ause of the nature of CETA. But in large part it is also because 

of the nature of the questtens on which the regionart offices have decided 

to focus and on the style,* training, and capab^^itie^ of the federal' 

\ representatives (see Van Horn, 1977).' As out recommendations later in 

this sect;lon make clear, we do not think that such a relatively passive 

* ^ole for the regional offices is either inevitable or desirable. 

* « 

Figure 4 pi;esent^ a simplified model of the relationships that explain 
performance for Title I of CETA at the prime sponsorship level. Several^ 
s imp 1 if locations have taken place when Figure 4 is compared to Figure 3. 
* First, the mildly constraining factors and relationships havfe been removedi 
Second, because aggregate characterl8tlca| of participants served have 
very little impact, on performance as Measured by general, achievement of 
local goals and by a variety of lndi<lators of placement, cost^, and 
non-positive termination, it seens reasonable to consider those character- 
istics as another feature of program performance. 
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FiailE 4: sf^iPLIFIFD MODEL FOR EXBL/JNIUG PROGRAM PErvFOR>IAKCE 
• FOR TITLE I OF CETA IN, PRIME SPONSORSHIPS 
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Preferenc^/ Priorities, 
and CojDBisi^raents of 
Infjliential Actors., 



Local Management Decisions about 

Manpovrer System 

' !• Quality of Staff 

2. Quality* of Data for 'Decisions 

3. Quality of Monitcring/Evaluation 
4# Degree ot Subcontracting 

5# Mode of- Service Deliverer Selection 
6; Openness of Deci^on Systea 
7. Management of Conflict 
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Program Mix 
(proportions of class- 
roon: training, 'OJT, work 
expetience, PSE) 



Program. Perfcnnance ' 

1. Characteristics of Participants 

• . ^ 

2. G£ 
Goals ' 

3... Placcment/Cosj&/-<Mon-positive 
termination^) 



Sar.eVal 



AchievfciLent of Local 
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i^follov/"fnn briof ^^tTiary of. the principal flrdingo frota our research 
is orp,anlzeclh*ft^mcl the relationships portrayed by the four airrews in « 
Flgurje A . 



SUl^RY OF, PSTNC^PAL O B SERVED RELATIONSHIPS . 

The Impact of Influential Actors^ Preferences on Program Mix 

/' J.. Actors' preferences for different kinds, of programs hod an impact 
:<fn the program mix actually chosen. The more influential actors had Lhelr 
preferences more neatly s~atisfied than the less influential actors. This ' 
finding is, perhai^s, not profound, but it is reassuring to know that 
program mix is not somehow determined by forces beyond the control of the 
actors in tjje system.^ \ 

The Impact of Influential Actors' Preferences on Program Performance 

1. Actors' pi^eferences about who gets. served in fact helps determine 
who gets served. Again those with more influence in the system tn general 
also get more of their preferences satisfied in terras of the kinds of 
CETA participants enrolled. 

2. Staff members are more likely ^o achieve goals on which they put — 
higher priority than thode on which they put a lower -priority. Commit- 

fcnt counts because, in fact, it signifies a willingness on the part ot 
staff to take the necessary steps to make the achievement of the higher 
priority goals more likely. ; ' ^ * - 

3. ^ Prime sponsorship staffs with stronger commitments to training 
programs and placements vill also be the most likely to have programs 
that perform better^on the various placement and cost measures we have 
used. . * ^ • — 

The Impact of Program Mix on Program Performance " — — 

1. p/ogran mix helps determine the nature of the participants who 

will be served. Expenditure of Title I funds on PSE is associated 

strongly with' fei-zer economically disadvantaged and tfem^le participants. 

Expenditure of Title I funds on classroom training is inoderately related to 

a iilgh proportion of service to the efeonomically disa dv antaged 

Expenditure of Title I funds on work expep^ence is moderately highly 

related to .a high level of Service. to women. Other relationships are weak 

and/or inconsistent over time. * . 

* 

2. Program mix also influences program performance. Specifically, 
relatively high expenditures for and enrollments Ih Oj;p'^lp6 produce 
strong showings *on placement and cost indicators and^lso leads to some 
improvement in the non-positive termination rate. Relatively loi^ expendi- 
tures for and enrollments in work experience also help produce strong 
performance as measured by placement and cost indicators. 
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The Impact of Local Ifa naggre nt De clsl or s on Pr ogra m P< ^rfortpance 

/ . , This area is the one in which we havt: put much of our effort both 
In terms of orir^inal data collection and in terms of analysis. It is also 
- ' the area in wSlch vre have the most findings • The central overarching 
finding is that management decision^, as we have defined them, do have 
the potential for .improving program performance. By thewBame token th^y 
also hate the potential for contributing to deteriorating performance."'' 

1* High quality staff at all levels is associated with the ability of 
a prime sponsor to set reachable goals, and attain them. 

- 2. High quality staff at all Ifevels is associated wfth good 

^^rformance on placement and non-positive termination measures. 

♦ ^ 

3. The uSre a£^ood data for planning is associated with the making 
and Implemeutation of "^tms clous choices abbut what participants to serve. 

^ 4. The existence of high quality monitoring of programs within a 

prime sponsorship helps lead to good performance as measured by placement 
rates and cost ratios. ' , • . \\ ^ 

5. The existence of high quality monitoring and evaluation has the 
effect of helping reduce conflict between 1)rime sponsor staff and 
subcontractors engaged in service delivery.^ The reduction of what is often 
extraneous and unfocused conflict is assumed to help^ increase- service 
delivery success over time. ^ 

6. A prime sponsorship, that reHes entirely or aliiost entirely on 
subcontractors for service delivery tends #^set and achievd goals better 
than a prime sponsorship that retail^ a considerable portion or all of 
the system for in-house delivery. 

* >w 

7. A prime sponsorship that relies extensively on subcontractors 
for service delivery is more likely to* have good performance in terms' of 
placement rates and costs than a ,prijne sponsorship that retains all, or a 
sizeable pgrtion of the system for in-house delivery. 

8. I# subcontracting for service delivery is done tl)ifough some form 
• of a request-for-pr^posal, this will help increase the perceptions of the 

actors in the manpower system that the proportion of **rat^orial" decision- 
making compared:.to ''political" decision-making is increasing. This 
perception helps reduce unfocused conflict within the system. ^ 



9. Prime sponsorships with relatively open decision-rmaking proceeees 
vill make more conscious* choices about what participants to serve than those 
with less open decision-making processes.' 



10. The existence of more open proce$ses does not reduce conflict 
but does help to sharpen and focus it on I'e la tlvely important issues, such 
as significant segments identified for service and the relatiot^ of 
siSecific deliverers to the achievement 'of systenj-wide goals. Focused 
conflict is related to conscious decisions about total system design. 
Such decisions presumably will lead to a' higher proportion of general 
go^r achievement over time. • > *^ 
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11 • A conflict inan«''/;eTh-»nt stratogy that opts for totAl avoidance of 
overt conflict isiUkely to increase unfocused conflict (it certainly will 
not reduce it) r^d Is ]ikely to decrease the chancea that system design 
decisions are mcde S'B^f-colnrciously and after assessment of some alterna- 
tives. A stra^^gy' that seelcs to shape conflict so as to focus on Important 
decisions also seems 'likely to lead to more conscious decisions about 
participants end a higher degree of general goal achievemefit over time. 

Our findings about tjie relation of .management decisions to program 
performance are summarized in Jable 32. Tne table reports cases in which 
our evidence supports assertions that specific aspects of management have a 
beneficial impact on several major elements of program performance. The ^ 
empty cells Represent one of two cases: either 1) relationships we' 
tested but that were found not to be present in either direction, at least 
using the analytical techniques we chose and the data ye had available; or 
2) relationships that may be present but for which we did not test. 

Reduction of unfocused coi)/lict is included on the table even though 
we did not use it as a direct measure of performance in our research, 
because we have ofeserved that its presence helps deter goal achievement in 
primes and its absence is beneficiat instrumentally to the achievement of 
other goals. 

k 

REOM^IENDATIONS 

The specific recottimendations in this section' are based on the findings 
and observations contained in this report,, in out detailed reports on the 
15 national sites, and in our published monograph on CETA in Ohio 
(Ripley and others, 1977). They are not merely generated from our own 
values and opinions, although we have also tried to make those values 
and opinions clear where appropriate. There are empirically supported 
reasons for making^the specific recommendations we have chosen to make 
and for believing that the adoption of them would promote^ better CETA 
performance . 

Recommendations are offered in seven major areas: 1) service to the 
disadvan::aged; .2) level of commitment to training and placement; 3) open 
decision-making at the local level; 4) motiitoring and evaluation^ 5) subcon 
traciiing and service deliverer selection; 6) business involvement in CETA; 
and 7) organi^d labor involvement in CETA. 

y The implementation of many of the recommendations that fol^low would, 
of* course, be the responsibility of local prime sponsorships. But there 
is also a definite and important role for the Department of Labor in the 
imp^rovement of CETA programs atid performance. We take the view that, 
although CETA is a decentralized prpgram administratively, it is still a 
^program with national purposes. We think* that DOL can help define and 
achieve those national purposes by timely and focused activities and 
interventions. In order to be maximally effective, DOL must focus on those 
goals Imbedded in the statute that it can- reasonably hbpe to influence.,^ 
Some of the. recommendations that follow would involve day-to-day 
activities of the regional- of flees , some would involve the leadership of 
the national office of ETA, home would involve changes in the statute, 
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Table 32: SUMMARY OF OBSERVED REIATIONSHIPS BETWEEW MANAGEIIENT DECISIONS AND PROGRAl'l PERFORMAN 
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and con:e would involve primarily local activity. A number would require ^ 
Specific actions of several different kinds^. 

We are npt^arguin."; for either re-ccntralization or re-categorir/|^iorf of 
manpovjer prograuis . ^Je think that the decentralized adminl§X»t*Dn of CEXA 
makes a good deal of sense, especially when accompanied by limited, but 
dmportanc. leadership from DOL. - / ^/ ' 

We certainly do not see the utility of the expan^on*of DOL activity 
^and requirements in all- areas of CETA. Local desires andx^prefcrenco? 
should be respected in many areas. Focused leadership fr6m t*he Department 
would involve more concentration on important national goals (for expaple, 
service to the disadvantaged) and fewer demands on prime sponsors In ^ 
less important areas (for example, some grant proposal and reporting { 
requirements could be simplified and some areas of DOL monitoring and 
field assessments could be eliminated or at: least reduced). . 

We would also observe that many. In fact most, prime sponsorships 
would welcome competent, systematic technical assistaijicf from DOL in 
the form of concrete advice on how best to engage in meaningful labor j 
market planning and how to tlje such plajmlng^o program decisions. Even 
good local staffs find it very dif ficuM^ to interpret planning data when 
th§y are trying to develop 'yu ^icies aj >d programs related to thosp'data. 
Thus even good staffs often react only to data on the operations of their 
CETA programs (Intake, placements, and so on) in making program" adjustments 
rather than also reacting to data on changes in the local labor market* * 
POL assi$tance in^ this area, which would first require considerable ' 
training of federal representatives, would be very valuable, even ;to local 
staffs that are already very competent. There would also be some upgVadirig 
potential for less good Ibcal staffs in this kind of assistance. Given ^ 
the vital importance of high quality local staff to good program perfor- - 
mance revealed by our research,- DOL should consider making this , area of ' 
training f or^ federal representatives a high priority. 

Service to the Disadvantaged , 

The claimgf.of some prime sponsors that thay cannot serve the mSst 
disadvantaged and mainJBin good levels of performance ,can be rejected on 
the basis of our evideWre. High ! levels of service to the disadvant-aged and 
good performance can go together. ^ ; 

DOL has increasingly stressed service to the disadvantaged in CETA in 
the last few years and fias publicly worried about the tendencies o| 
many prime sponsorships to sert^e fAwer disadvantaged. We think both ^ 
the emphasis and the concern are warranted.Jf We hope that all , prime. 
sponsors will voluntarily adopt and pursue such an emphasis, as maby haye 
already done. However, when prime sponsorships are reluctant oir^^unable 
to pursue this emphasis voluntarily, the Department Of iJabor has a number 
of courses of dctiqpi it can follow^ tx> generate such an emphasis. 

I i; Regional offices of DOL should examine more closely the agreement 
between prime sponsors* participant service pat-feerns and the actual heed 
in the area during plan reviews and modifications, and then monitor tfie( 
performance of the prime sponsorships in achieving those plans. Under ^- 



service to the ncoTiornically dl§aclv ^ntaj^ed should be o2 pa :ticular concern, 
Ite aft not suf;i;je3tln<^, iiowever, the necessity of a perfect correspondance ^ 
between universe of rrsd and plartncd Service. 'Given varying^ "local feoals, 
there may be good renoon^ to overs tress -one or tnore groups In terin^ of 
service compare J to presence In- the uofverse of need. But decisions about 
6u9h emphasi»<5 should be consclotia and should require Qxt)llclt justification. 

2. In order tQ,.;yT^j)lcmeat the f irst^^recomraendatloh effectively,* DOL 
must take the lc<id In addressing' the- problem of data quality for maklhg 
judgnnents about universe of nedH. \ . ^ 

Relevant data must, qf course, be available" and interpretable at the 
* local level if tne local officials and staff are going to be responsive 
to this, ctephasls. DQ^ cad help the primes attack the dat^ problem In 
two ways: by mandatlngfci|taln kinds of data -collection and reporting gnd 
by aiding in th^^evelopSent of definitions and sources of goocjj|^ata; 
Primes could be required to report participant characteristic data broken^ 
^G\7n by major program component,* by servlcfe deliverer,, and by major 
^jeo^raphical. subdivision^, in the prime sponsorship (including separate 
program agetvts^in the pSe programs). They could also be; required to compile 
longitwdinal trjend analyses ot a sDnple charsft^ter on chan^ffig participant 
characteristics by titles, program^omponents, service deliverers, and 
Igeographical areas and program agenls. 

Prime sponsorships tjiat are most, ef fectlve^n stressing disadvantaged 
participants unciertake such analyses on a routine basis and use the 
results as a management tool. It enables, them, to exercise control of 
what is, in many cases, a highly decentralized^ intake process. Decentral- 
ized intake, however, need not" mean uncontrolled or random patterns of 
partitipant service. \ • . 

The central conceptual problem ^L' should, address Is developing^ an 
TOthoritative definition .of "universe of need." Once the definition Is • ^ 
. developed then ETA should work with tbe Bureau of Labor Statistics, the 
Employment Service, an,d the Bureau of the Census to develop reliable. and 
useable data that vould be routinely available for prime sponsorship use in ' 
the plarihing^nd operation *of 'their programs. . Many prime spcnq^rships ^ 
are still in the^^osition essentially of 'guessing about their Wniverse , ^ ^ 
oftnee'^d. And diffet^at 4)rime4 use very different definitions pf universe ^ , 
of 4iead, often only ijnplicitixas they address the oyoblem. ' H 



♦ We /realize that improving data* for' this critical measuremeht in the 
tnagnitudeAab.out which we are talkltig will be costly, -.However, the most 
effective managemeat of both CETA and other local^Jr Implemented programs, 
cannot be achieved withou-t better data for planiling an4 for measuring^ 
performance. ' ' ' - . 

3. Prime^ should be given some incentives 'for collecting and ufing 
good data.^ Even clear; requirements *in the regulations might not produce the 
desired performance. The incentive structure at prese^rt-^ten seems to 
^omote sloppiness and ^erh^ps deliberate manipul^Mi of numbers to 
please or at least placate a* given federal representative or regional 
'"office, * . ' ' . ^ ^ ^ ' 
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Soi^ negative inccntivr.s are iiiplied by the. first recommendation, above. 
If DOL monitorin5j of perfui.inance in this area is serfous and well-ex ecutod, • 
• primes not perf o/^nJr well might be "subject to delays in funding, letters 
I. ' . , to political officinlr and advisory councils, and ''jawboning" by DOL 

' . officials^ * * 

f ' ' ..- ^ 

^ . But r^^i/.ive incentives should also be sought, ♦as they often work 

better than negatlye incentive^. As ,a hieginning,- a few pilot prime 
sponsorships, ones that have already shown -some capability and leadership 
in-ttie are^ of using* good data to support an emphasis on disadvantaged 
. participants,, co;ild be given some extra funds. These funds would pay for 

eUbra staff persond and/or time to develop the techntflues of ^ data 
management and analysis further and to demonstrate them tcT other primes 
' ' in their regions. Tlie Secretary could also'use discretionary money he 
• . ^ ftlready has to reward prime sponsorships engaged in careful analyses of 

' un'i verse of need and, more important, engag^ most cpnslstently la 
serving national priority groups in that universe o£ need* 

/ * 

^ . A. If added and consistent st?ress on disadvantaged participants is - 

' 1 jM an important goal in CETA, then it could be strengthened by some spftjfif ic 

changes in the statute: . ' 

, • "F ' \, ■ ' 

a. llinimal levels of service to the' #qpnomic«lly disadvantaged 
could lie specified: for" example, 75% otf all^Title I, participants for 
eyery prime sponsorship and 50% of all PSE participants. 

' b. In the allocation formula, for Title I (section 103) *'low- 
income level" could be changed to "poverty level/* Or, if that change 
would treat areas with large numbers of the '"working poor" (those Who a£e 
^ motivated to work but are stuck in unfairly low-paying deadend Jobs in 

the secondary labor market — See. Doerthgef kvA Piore, 1975),' both elements ^ 
could be included in the fprmula., 

c. Also in the allocation fprmula, the relative weights of ^ 
nemployment, low-inc9me level, and poverty level (if .used) could be 
changed in favor of the latter two considerations. Careful projections 
of the . impact of such changes should bje made^before any f;Lnal decisions arc 
reached. Greater stress' bn low- income or poverty could be expected to 
increase aliocaCi^.n6 to rural southern areas, for example. In order- to in-^ 
crease allocations to^'older citjLes, particular]y in the northeast, the 
formula might need to be changed so as ^to reduce the 50% of the alloxi'atlon 
\ based on the previous year's allocation and* simultaneously to increase 
♦\ the^prcentage of the allocation based on the combination of Unemployment . 
*and low- income /poverty. ^ * 

{A. .The phra^^'those^ost in need" (section 105) should be 
specified more precisely — ideally in Accord with some good definition 
of uaiv^rse of need for which data are available. ' , 

; ' ^ ■ I ^' ' ' - ' « 

e. In the section of definitions in the Act th^t affect ♦ 
eligibility for CETA services (section 701), a restrictive definition' of ' 
economically^ disadvantaged should %e included. For ex^p^e, the*^povert5jy 
level could be used, or a mix of low-income level and poverty level could 
be used. Ihe concept 6t ^-^underemployedV might be refined to address* the 
problems of the working poor (as defined abovei more" explicitly . - 
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"Unawploycd** ml^ht br^ qurliLiod by addling ^j^perioi- of tiiR3 f^r wUlch a 
perscn has to be vmmployed to be Biigible (for example, between 30 and 90 
d^fs) . Unemployrd c>nu underemployed peri^ons below the poverty level 
•woyra\ of course, st.'^l be eligible at any t^r.e. But those above the * 
ppverty l^vel would have to meet more jatringeht criteria to be eligibleV^ 

Level of roT^rdtnent to Training and Placement 

The Department of Labor has recently shown an increased level of 
cornmitment tQ, training and placement in CETA. Such coinnitTnent at the local 
lover has been demonstrated in this report to have the desired payolf • 
Therefore, we think that both the national and local commitments r.re 
proper. In addition to continued "jawboning^* in favor of a stress- on 
training and placement the following steps should be considered: 

1. DOL should take the lead in providing the methodology for * 
developing more refined data useful in deciding for what pccupations ^.'^ 
training shoufd be offered and for how many people, A vagu6 general 
commitn»nt to training may result in inappropriate trafining for jobs that 
aijeTuot really there or that have been filled before many of the trainees 
have completed their training? Likewise, DOL should insist that progfam- 
specific performance da^a be kept that could be used in making decisions 
about creation, discotltinuance, and size of specific trailing modules, 

2- Given the ef f ectivenes^s of PJT but the relatively ILuited use of 
•it, DOL might consider allocating a little incentive money to' prime 
sponsorships that are willing to increase .their OJT stress in creative 
ways, assuming', of cours*e,Hhat .analysis l(ad"aeterrained -that the local 
OJT market is not saturated. 

3, Present DOL discretionary money allocations might be more closely 
and .specif ically tied to high levels of conmiitm^nt and/or performance 

in the training and placement areas on the part of primes receiving it. 
Thj-s could include some PSE discretionary money that could- be set aside 
for primes that had developed ^ training component to their PSE programs. 

4, TJie^ consortium incentive allocation could also be tied specifi- 
cally to performlmce in the training and" plac^ent field by consortia 
rather than simply given out automatically to consortia that geographicall:" 
encompass most of a labor market. There ^^ems little point in giving 
extra Title I funds to a consortium siim^y so it can fund more work 
experience prograrijs or even divide up a^izeable amount of the funds 
among the partners to' use for Title I PSE programs. If the Secretary's 
discretion to do this is not clear enough under the statute (section 103), 
then the statute should be amended. Other programmatic criteria (such as 

^.comprehensiveneslO' should al^.o be J.eft as legitimate criteria by which 
the Secretary can deter^nine the amount of consortium funds to be allocated 
in an}j given case. In an^^ event, there is no evidence in the literature 
that c6n90Ftia are automatically better in programmatic terms than other 
primes and' therefore deserve an automatic add-on in their Title I alloca- 
tions, ^ " 

5, It has been found in another study (MDC, Inc* , 1977) that, as 
presently constituted, the 5% vocational education portion of the special 
grants to governors (section 112 of the statute) Is not very useful. 
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If tt>C provision- is not<' sCxMppcd rltogcthar, It minliv b3 made moye useful 
by tying the clistrlbutioVi o£ the Honey \'lthln states to an incentive 
formula that \70s^d r^ot-^drd prime sporisornhlps for their ovn efforts in 
the tlassroon tra5.r:5.t\^ Area. All or part of the money might also be 
tied to suppcrr, Jor sVills centers in prime sponsorships, if they are 
considered useful training institutions that can be made responsive to 
labor mn'*"^'?': chnnp,es , in a number of oar suites we found evidence that 
skills centers were being closed or cut,*back because they suffer -a 
comparative disadvantage with public vocational schools, which receive both 
state ar|d local support • '/^Irus a prime sponsor pays the entire cost of a 
slot in a skills e^ter hmt pnrly part of thQ cost at other vocational 
education Instltutlofts^. 

6^ The evidence is that 4% grants to governors are not used very 
effectively in most instances and are often used simply to feline 
Specific prime sponsor costs or*for PSE (see IIDC, Inc., 1977; and Ripley 
and others, 1977) . If it is politically necessary to leave thes^ 
grants, in the statute, '.at least language could be adfled (section 103) 
specifying legitimate^ uses of the grant and tying those uses to training 
activities * , * 

7, In order to foster at least some emphasis on training in Titles 
II and VI^ a provision should be acfded to the statute requiring that some 
small part of^ thelt mdney (perhaps 5% or 1G%) be used for training. • 
Simultaneous elimination of the program agent provisions (section 204) 
would also be useful in giving the {Jrime sponsbrghlps. clear and' 
unambiguous responsibility for the 'administration of all money coming' 
through Titles II and VI., 

Open Decision-Making at the Local Leyel ^ . ' 

^ Especially for purposes of focusing debate on p\lbllc^ issues and 
.reducing unfocused aebate and suspicions about" rigged decisions, an open 
decision-making pr-ocelss at the local level is very Valuable, During 
our field work v/e witnessed and commented on several e'ffectlve variations 
of such a process. x ^ ' ^ 

The advisory council is at the^'iieart of an open decision-making, 
process, although the process cohsl$^s of more thart simply having an 
involved council. * » . ' / . ^ 

In those prime sponsorships in which an actlye and influential council 
was present one of two conditions w^^^ Itk^ly^ to exlsl:: either there was 
a relatively high degree of harmonJbjip agreement about the shape of the 
CETA program or, even if agreement, wfi^ not present, a process for dealing 
with disagreement was. in place and^ fulpctioning and , ' most important, that 
process was widely 'regarded as legitimate^ Ihus, solutions could bfe 
reached that would leave even those* i^ose interests had been given less 
attention with a feeling that a fair pvocess^'had been used* . 

In those primes in whlcHr the S^dyi^ory coupe i! was not influential (even 
if active in 4 pro forma way) one .of two situations was likely. Either f 
there t^ere unresolved conflicts that were harmful to at least some aspects 
of the program, or the staff felt it necessary to adopt a ve^ conservative 
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attitude toward their progran. The ccnservatlvo stance uas adopted 
because staff IsU'that any changes or Jnnovatlon3 ml£ht threaten someone 
and the system d/d not h^e Br process widnly recognized as legitimate 
for dealing v^^tV the conflict "that might 6rvipt tf change wece proposed 
or pursued, ^ J ~ ^ 

1. Our. first recdmmantfation is very broad J- . It is simply that prime 
sponsors without one consider seriously the merits of developing an open 
decislonr^king and planning process that has at leaat the general 
features indicated below. ,Reglonal office representatives ^omU monitor 
and give suggestions on the establishment 6£ such a process, althouga 
basically the initiative has to be locaU Naturally, any given local ' 
process will vary somewhat from any other specific ^ocal process because 
of specific needs, conditions, and personalities. But the general 
outlines of what we have found to be very, useful have wide applicability: 



» 



a. The process needs to focus on the establishment and articu- 
lation of local goals. Broad goals should be considered first, and then 
more specific goals involving choices of program activities, significant 

^segments, and service deliverers can follow. 

b. Whenever possible, meetings should be open and widely 

publicized. Participation of Interested persons from the* conmunity 

should be stimulated, not just tolerated. 

^ . ... 

c. Data should be brought into dlscqssions in the public process 
•by staff. This will encourage the participants to deal with more than 

Just rhetoric and to make choices at least in ^rt on the basis of data 
and analysis. , 

d. The institutional core of the open decision process is -the 
relationship between the staff, political officials, and advisory cojuncil. 
Staff and the council should interact on reconaiendations and decisions. . 
They then can make their recommendations to the political officials.' 
This constrains political official choice to soToe extent, hxit also 
offers •prot;ectlon to the political officials from charges thaC they are 
proceeding arbitrarily— without reference either to data or to views of 
interested parties. . , 

« . 

e. The advisory council needs considerable encouragement and 
direction from staff, at least until it is a self -confident, routinely 
functioning part of the CETA system. Support consists primarily of staff 
time and preparation and explanation of special data analyses readily 
grasped by, a volunteer council. , , - 

Th% vaiLue of ^the o'pen process outlined above is underlined by our ' 
finding that prime Sponsor staffs that use strategies of complete conflict 
avoidance often perpetuate the weak^ featured of their tfotal program., the 
open process is at th^ heart of a conflict management strategy that focuses 
disagreement on important Issues. - 

2. In addition' to local initiative in developing an open decision, 
process (and regional office helpfulness and, when necessary, insistence 
In promoting it), several amendments to the statute would* be helpful: 
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, r a. It ^lould bo specif led (section 104) thot the chairpersbn ,of 
the cdviGory council cannoir be a>^ elected official or professional manpower 
staff meyber votLlrn ^<^t^ the pritoe sponsor*. - ^ 

b. The rc*sponsibilities of counc ils fia^ considering al^CETA 
plans* and activities, not^just Title I, should be made clear (section 104). 
The lanrvnr.- used in .the 1976 Title^VI amendment (PL94-4AA, section 609) , 
ml^it serve as a model for such expansion. ^ i ' 

c. Servicp deliverers (subcontractors) should be ^prohibited from 
being voting m^befs of the C9uncil (section 104) . The r.egulatlons prohibit 
service deliverers from voting on their^^^pwn programs but we favor fhis 
additional pjro^hibition and /TfilWk JLt slfculd be in the statute. 

d. A, new standard assurance should be required of prime sponsors 
(section 105) that advisory councils v^H have ample tim^ and notice to 
consider proposed plans and fliajor modif icatioij^ in those plans for all 
titles. ^ 

Monitoring and Evaluation^ ^ 

V 

^ Monitoring at the local level is both feasible in all prime sponsorships 
and is essential to program management that helps lead tx> better 
performance. Evaluation is more complicated and is presently feasible only 
in different forms ^.n different prime sponsorships^ Ultimately, we think 
it has a great deal to contribute to management that leads to better 
performance, but we certainly would notclaim it is a cure-all or that 
it is easy. Good monitoring ancf evaluation have also been shown to reduce ^ 
debilitating conflict bet(/een prime sponsor staff and service deliverers, 
an important precondition for making cooj>erative programmatic •improvements.^ 

1. Essei^tial features of a good tionitoring system thatr should exist 
in all prime Sponsorships are specified below. Regional office 
representatives should be trained to offer specific help in establishing 
or inproving such systems ^jThey should also carefully assess performance 
of these systems. 

a. The'local Managen^nt; Information System should be supportive 
of monitoring. This means,, above all, that the emphasis in developing 
tUS be placed on developing a system that is able to be understood, and 
used by all of the staff members dealing with monitojfteg. 

b. Monitoring entails both on-sit^ visits and desk reviews of 
reports. A standard report formWill often not be appropriate for 

all programs, and variants should be developed when necessary. 

c. All programs and deliverers should be monitored routinely. 

«- 

d. Monitoring needs to be tied to corrective actions or ft is 
a waste of everybody's time. 

*e. Feedback to those monitored should be maximized and should 
be given in the spirit, of helpful (but forcef ulj^technical assistance* 
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2. Evaluation of a cptclflc, technical nature should be undertaken 
only when sojpe critical precou'Sitions are met: ^ ^ 

*■ — ' 

^ a. There .is C'-^^uine competence in the staff to undertake 
evaluation, • ^ 4 ^ 

b. There are clear local goals tfiat give meaningful context to 
'the evaluation activity. ' . ^ 

c. There are definite plans^Nr using the evaluations in subse- ^ 
quent^ decision-making. 

3. Ideally, the results^ of evaluations should be made public in the 
context of the open decision process described above. 

Subcontracting anj^^ryjce Deliverer Selection ✓^-^ 

1. Because CETA delivery systems that are all or mostly subcontracted 
tend to perfonq better in terms of generatl goal achievement; and specific 
performance measures than other systems, prime sponsor^lps and the 
Department of Labor should jpromote this kind of delivery, although we 
realize /It is not completely appropriate in every local situation. 
Mixed systems — with , substantial In-house components co-existing with 
marjor subcontractors— are particularly dlfficjtflt to manage in l^rge 
prime sponsorships, because competitors usu/dly believe (often with 
justification) that the in-house components receive favored treatment. 
This is not necessarily the case in smaller prime spc^or ships. There 
it may be possible to retain' one or a few specific major components of 
the system for in-house operation without creating serious problems. 

'2. Inhere subcontractiiig is used, some form of competitloi} for 
designation as service deliverers is healthy and likely to enhance both 
management potential and deliverer performance. That form need not be 
an elaborate, annual, formal RFP' process for all program components. 
There are ,niany variants to an RFP "spirit" that can be tailored to local 
conditions. An RFP process, of whatever specific form, is likely to have 
additional utility if it is tied l)oth to performance contracting and 'to 
'the open decisj-on process described above. 

Business Involverrent in CETA 

There is only limited hard evidence that business involvement in CETA 
has resulted in better program performance. But there is at lea^t scatter- 
ed evidence, both in this report and elsewhere. And there are good 
theoretical reasons for expectin§^ that, in the long/tun, business involve- 
ment could be Very helpful in the sense of opening positions for CETA 
participants (see Blair, deMik, and Doggette, 1976). The lack of- 
evident impact is, at least in part, because there has been so little 
" business involvement to dat^. ^to8t prime sponsorships, even very good 
ones, have not developed a well-rounded strategy for attracting and 
ret aining impo rtant business involvement. 

1.' Our general recommendation in this area is that prime sponsor staff 
should develop and implement strategies for involving business Several - 
specific first steps on the part 6f staff menijers seem feastbl^and ^ 
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potentlall^^urf^fnl : n) to nalc: rurc^ tl.at th«re is a :J.:3 ,.b]e number of 
buslr.eos rrp- r ieiit ^tlves tn the Puvlsory council vpo.ijiili^ in fact, attend 
and participate; b) to ur::,e political pllici^ls to uae th^ir contacts in 
the business coi^TiunJty to promote soma Interest in CETA; c) to work with 
individuals froui tha business xommunity in developing Occtfpalionai forecast 
surveys; and d) to publicize successful CETA placements already made in the 
private sectr.v . , ' - ^ , ^ ' / 

4 

Organized Labor Involvement in CETA 

There is even less labor involvement than business/involvetient ia CETA 
at present. Thus there is certainly no evidence tljat it is "nece-^sary" 
for CETA success in a statistical sense. However, given union control over 
job Bntr>' in some trades, it ^kes se^se to make at least the following 
minimal recoiranendation in this area . 

1. Prime sponsor staffs in he#M.ly unionized areas snould, with the 
encouragement and assistance of DOL, attempt to get serious union 
involvement in CETA. At a concrete level, the . possibility of using 
some CETA funds for apprenticeship or pre-apprentice programs should be 
explored very carefully. 

^ # 

— * 
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APPENDIX A: SUMIVJIY CT LO^/iL GOALS AIT) GO:U ACKIEVEMTirT, 
15 SELECTED ^^RIME SPOKECESHiVS 



PrtTC Sponsors hip 

Conroctlcut 

Balance of State 1. 



2. 



Goal 



Place cllentsi in unsubsidizftd^ private 
employnent 

l^aKlFilre use of Tlt]« I no^^-v ^-^i clot 
tor clrssrooxn training ovd OJT 



3* Improve coordination uirL Eb 



4. O^fer servicos to des^cnated algnl- 



P':.//:'?e of Si.*cr5':<n 



1 ; 



Ii?dcf?.t' .* y high- 
Hish 



Moderate 



Lowfill Consortium, 1. 
ttc;6£>aclm3ett8 



2. 



3. 



4. 



5. 



Hold deliverers responsible for 
performance and build a Danpower 

system in the process 

^ - - 

Control and manage politics related 
to CETA 

Involve the private sector (busincina 
and labor) heavily 

Achieve high rates "of placement and 
retention in the private sector 

Put ppccial ?:tress on serving the 
Spaaicli-A^ierican coiKr.unitj^ 



High 
High 
High 

Moderately high 
High ^ 



CinRbf»rli:id 
County, N.J, 



\ 



1. MiMi-i»i?e cnnflicjl, maximize go-i 
roldicr.G, and irnxliTilze cejitrali7,cd 
p*'os\vric^tlc control ^ 

2. Hota'jllrh and maintain e high de^rne 
of d^categor 1:^.1 fcion and cowj^rcheu- 

^ivr.ncs8 

3. Coordinate CETA with other conFmmJty 
and social scrvlcn ag^.vcino and clforto 

4. S*?rv4 te!i(tr>orovji7 tmeirployrd hcr»'l3 of 
hou?«:aold vlfh TitJ.e II ttid uoe Title 
Vl for public works projects 

5. Achieve high placeisatit rates 



High 



ni*;h 



Hl3fi 



ERLC 
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Prlaw SpoMorahlp 



Goal 

!• Estshlfsh a comprehenoive, well- 
stmeturnd delivery systooa 

2. Enhance the 8elf*-8ufficlency of cllerttc^ 

3. Serva most needy participants 

4. Place participants in unsubsudlr.ed johr 

5. Ssrvico oignl€lccnt enpsicr.to ^ 

6. Create and maintain a centralized c^iit 
for manpower cervices 

7. Control performance of deliV3r^■»r3 

8. Improve job development 



Degree of Success 

Modetptri * 
Law ( 



2. iTiprove the program performance of 
contractors 



High • 
Sith 



Wjlmln.<^tony Del. 1. Place clients in unsubsidieed employment Low 



Moderate 



Luzem? County, 
Petmsvlvania 



Birnlnghaz) Area 
Monpowar Csrt., 



1. Create and maintain decategorized 

and comprehensive system " High 

2 . Achieve County control of prograr3 High ■ * 

3. Serve significant segments * ^k>oGTate 

4. Achieve high placrinent rate in thG 

pri'^hcc^ Rector Moderate 

5. Cut^ cosi s ' Moderate 



&. Transition PSE employees to permcncnt 
jobs ^ 



Low 



1. Increase potential for job place'Ai:?nt 

2. Serve target groups \ ^ Rljh 

3. "Avoid conflict ^ Hlch 



Mo<^ci:ete 
(*7f-ry goal) 



v. 



14 



PrlM Sponsorship 

Cunberland 
County, N.C. 



Goal 



lV»crc?^ of Sncc5^9^ 



!• MaKltu^je tli2 amount of CEIA rr»cnry spent ^ 
cn d're'zt employment and trailing 
8e?;vlcea for clients 

2. Serve those most In need, especially 
low Income and minority persons 

3. Place people In permanent employment 



Mod::ra^e 



Duluthy Minn. 1, Provlda more effective tralnjLng' 



Arkansas 

Balance of State 



Dallas nojniy 
Texan 



2. Provide Income maintenance to kaep 
^work force Intact 

3. Serve target groups set nationally 

4. Assure necessary liaison with various 
agencies and groups for improving 
programs 

5* Promote economic development 



1, Enhance the employablllty of every 
citizen and Insure ^at every citizen 
has an opportunity for a job 

2. Assist local governments to achieve a 
t high degree of control in planning 

and using federal manpower dollar-s 

1. Place clients in permanent, unsub- 
sldized employment 

2. H'slp itiiprova general econonlc sites tion 

3. Iniprove the subcontracting probers ^ 

A. Develop nontraditlonal tr^tlnlng programs 
for womnn 

'5r- Develop linkages with other social 
services agencies 



Mo 'itrcfcly higfi 
ftodf.ratcTy, .tow 

Moderately hi^ 
"Low 

(very ambitlouo- goa?.) 

Modcrntcly Icvr 
overall * 



Moderately hicJi 
(a new" goal) 

i^Mod^rately low 



Low (very bro|i'd) 
IJodcrato 

Moderately hl^ 

Modeirste 



* This t9 r.n unreachible goal as a whole. There has been an Unrr.-on y^tl^^^n o€ 
acI>ieveQrat on ppccific ccdtponents. The degree or success has becn*rei»>tJvp.ly 
high on a £cv compcneuts. 
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Prime Sponsorehtp 



Goal 



Central Iowa Re- 1, Crec^t^? i| professional, efficient 
glonal Association stcff 

of LCCr^l 

Gowrnments 2, Serve the greatest number: of eligible 

clients with the greatest need * 



Degree of Sacqesa 

(boElnninf: otzises) 
--a r^vT goal 



Low 



Drnver, 
Colorado 



1. Serve those most In need with 
available resources 

2. Achieve high* rates of placement and 
retention In unsubsldlzed private 
employment 

3. Guild an Integrated manpower sys^tem 
that is cost effective ^ 



Moderate 

Moderate 
(early atage**) 



Sacramento- Yolo 
Consortium, Cal. 



1. Improve quality credibility of ^ 
central manpower staff 

2. Retain conmitment to training activities 

3. Streamline and rationalize delivery 
system _ ^ • • 

4« llake program decisions on basis of 
good data 

5.. Increase number of placements 

6. Increase quality of jobs in which 
placements are obtained 



tow (new goal) 
Moderate 

Lot/ (new .goal) 

Low (new goal) 
Moderately low 

Moderate « 



K:?n^^*!?r!r>.ralr-h 
Cc;r': . V7rr.hin^Tton 



1. * Preserve tha existing consortiun 

arrangement (and delivery syst'^m) .* 

2. Serve those most in need in the 
target population (strcas on 
economically disadvantaged). 

3. Improve the existing delivery system^ 
incrementally (worlt to^-;ard a comprc- 
heiisive system).^ 

A. Place indivfduals in* uncubsidised Jobs, 



High 



High 



Mo<?9"at2 
Moderatol/ ^ov 



i 



If 

- I* 



A??r;!:>IX B: IirnfR-CORREUTIOK CF EIGKr PERFORMANCE MEASUSES tllR ALL. 32 SUES 

* - * / * ^ 



f 



^ Includes all quarters between "Dpceaberj 1974, and Deceiver, 1576. 
* ■ correlation less than 1 .20 

50 • ,'• •• ■ 
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Pl.-,:,^cr.t'. 
Effiri'ancy- 


^Plcifemeitt^ 
fate 


Indirect 
Placement 
Rate^ 


Encfered 
Eiap3foyiftent 
' /p^te 


Nonposltive 
Termination 
• Rate' 


Cost/ 
Indirect 
Placement 


Cost/ 
Platemert 


Coart/ 
' EnrolZee 


FT — 1 — r , zz — 




^ >C1 


■^"T 7?^ — ' 


•m 

.65 


■ r 

if 

-•31' 


-.45 . - 




•OX 


. ' ' , r 


. \ 1.00 


»* .53 ■ 


.58 / 


-.27 


-.52 


-.36 • 


.40 


Indl-Ti'ect V 
Placement' > 
Rii'te ^ 


■ - ■ ,f. ■ ■ 


1.00. 


it 


* 


-.37' 


* 


* / 


^Bplo^ant 
Rate , ' .It 




' 1.00- 


-.23 

1 


-.44 


-.42 




Nonpos^felve * 
Rate *\\ 


, ^ . ° ' ^- 


1.00 


.28 


.32 




Cost/Indirect.- 
Placeinent 

Li_ 


• 


1.00' 


.79 

4— 




1 Co^/PUca- 
ment 

4-J : ^ 




1.00 


.^.26* 

T 


i Qotit/Enrollfce , 

1 - , . 1 


. -^Sv. . . _^ ^ 
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